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ABSTRACT 


Cates CMi mies went my ss oLratesgic Defense Command 
(USASDC) relies on subjective judgments from key 
management personnel to make project funding decisions. 
In this thesis the Analytic Hierarchy Process (AHP) is 
used to convert subjective pairwise comparisons of 
thirty-five major USASDC projects, based on eleven Key 
factors, into ratio-scaled numerical weights. The AHP 
coefficients are then used ina linear Goal Program 
(GP) in order to optimize the funding level for each 
project in Fiscal Year (FY) 1988 at several different 
USASDC total budget levels. MU Optramake priority list 
of projects is also determined. The model results are 
compared with the proposed funding levels and the 
present priority list, anda detailed examination of 
the impact of changes of the model parameters is 
conducted. This analysis of the model results and 
model sensitivity stimulates six fol PG ler 


recommendations for USASDC decision makers. 
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I. INTRODUCTION 


In 1983 President Ronald Reagan announced the 
Strategic Defense Initiative (SDI), aprosrameaaes 
called for an intensive research and development ettenn 
in space weapons technology. The primary objectivewes 
the initiative is to produce a system of defensive 
weapons capable of defending the United Statesvand aa. 
allied countries fom hostile ballistic missile 
infiltration; to create an impenetrable shield Compose 
of high technology defensive weapons. President Reaaae 
believed it was time to pursue such a program based on 
his assumption tha the United States had the 
technological potential to bring his poal to Treaties 


A. SDI LONG AND SHORT RANGE GOALS 

The President’s initial SDI objective statemen uae 
now recognized as the long range poal of the wom 
program [Ref. cles By conducting a vigorous reséarer 
and development (R&D) program, it is hoped that the 
threat posed by ballistic missiles will be eliminates 
thereby deterring aggression and promoting security sama 
stabillity througnouc tie worka. 

Tie = Snort range goal Of enc SDI has been 
established as well. Before proceeding with the tome 
scale production of the defensive system, an initial 
period of intensive R&D must be conducted. A targa 
date of 1995 has been established for the completion of 
this initial phase to determine the physical and 
economic feasibility of the proposed system. The 
short range goal of the SDI is to provide the technical 
Knowledge needed to support an informed decision by 


1995 on whether or not to deploy a strategic space 


defense against ballistic missiles. Tits “decision is 
called the Full Scale Engineering Decision (FSED). 


B. SDI ORGANIZATION AND PROJECT FUNDING METHODS 

The SDI proposal led to the creation of the 
Strategic Defense Initiative Organization (SDIO) as the 
organization responsible for carrying out both 
mpectives of the initiative. An Army unit was 
established to manage and direct Army activities in 
spport of the SDI. This unit, the US Army Strategic 
Defense Command (USASDC), is headquartered in 
Washington, DC, and commanded by LTG John Wall. 
Additionally, the US Army Ballistic Missile Command in 
Huntsville, Alabama, was reorganized under the USASDC, 
since this command was’ responsible for many of the 
technological developments that stimulated the SDI. 

As will be discussed in detail in the next chapter, 
the USASDC does not use a project funding model to 
assist in determining the funding levels for the many 
projects they manage. The budgeting methods presently 
imeed are almost entirely subjective, relying on expert 
opinion and ivjformals prioritization techniques to 
determine project funding levels each year, depending 


on the approved budget from Congress. 


C. STUDY OBJECTIVE AND ORGANIZATION 

imetcweene  pramary Ob, ective of this study to 
develop an R&D project funding model of the presently 
funded major USASDC R&D projects. This model will 
Mmenmermine optimum expenditure levels for each major 
project in FY 88, based on the long and short range 
goals of the SDI and the project development goals that 
Will be generated in Chapter II. The model used to 
meet this objective should preferably have a wide range 


of flexibility and apply to each possible budget 


strategy. Results from this model will = be vcompanee 
against presently forecasted FY 8&8 fundins Tevelouam 
order to test the validity of the subjective meted. 
presently employed. 

This paper is organized to logically discuss. 
modelling process and results. Chapter II is devoted 
to additional background information critical) tome. 
model selection and execution. The third chapteres.aae 
consist of a search for the most appropriate projecs 
funding model among all such models currently used in 
the operations research literature. Chapters 2V aig 
will examine the development and formulation (ofa 
model being implemented, and Chapter VI will presem 
the computer programs written to perform the modes 
Additionally, the sixth chapter Wuaeel tender model 
results and output. Chapter VII will be reserved forme 
deliberation on the model sensitivity and valiqdivg 
The final Sehapcer Wade present conclusions and 


recommendations. 
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Il. BACKGROUND 


This chapter is intended to discuss in detail those 
items of background information that are critical to 
the development of an R&D project funding model of the 
USASDC. This includes Ee wd program element 
Structure, the present project development process, and 
the specific project funding goals that have been 
established by key management personnel of the SDIO and 
USASDC. 


A. SDI PROGRAM ELEMENTS 

Given the structure reviewed in the previous 
chapter, a technical program has now been defined and 
mip lemented . R&D efforts are structured into five 
program Selene rs - each element examining equally 
important SDI technology. Many of these programs have 
already been responsible for some outstanding 
experimental results. The five program elements are: 
(1) the Surveillance, Acquisition, Tracking and Kill 
Assessment (SATKA) program; (2) the Directed Energy 
Weapons (DEW) program; (3) the Kinetic Energy Weapons 
(KEW) program; (4) the Systems Analysis and Battle 
Management (SABM) program; and (5) the Survivability, 
Lethality and Key Technologies (SLKT) program. A 
complete description of each program element can by 
found in Appendix A. 


B. PROJECT DEVELOPMENT 

The USASDC has the responsibility of directing the 
research and development process for all Army-related 
SDI projects. GCirtctamweeetunding = for a particular 
project does not begin until a research objective is 
specified in a Work Package Directive (WPD). The WPD 
is a emit peal document that contains basic 


1 


administrative ~ iipoymai end and funding authority 
There are presently over seventy WPDS beings manaced mre 
the USASDC; thirty-five can be CcategoriZzedwias maja 
WPDs, since they involve annual spending of over $5 
million or are considered high priority (see Appendix B 
fer a description, of eachor The focal point for 
project management at the USASDC headquarters is the 
Program Analysis and Evaluation (PAE) directorate. 

The USASDC PAE shop is organized on program element 
lines: SATKA, SLKT, SABM, ~KEW.) anda. Program 
element managers in these sections manage the WPDs, in 
conjunction with the program managers and technical 
personnel located at research facilities throughout the 
worldwide R&D community. PAE program element managers 
are highly educated and have broad technical Mang 
managerial backgrounds. They must understand the 
intricacies of the R&D process in the field in ordereire 
make correct recommendations to decision makers. The 
most difficult and important aspect of the program 
element managers job involves the allocation jofF Jiu 
to the projects in their respective program eClenem 
areas. 

Presently there is no formal project and funG@inw 
model being used by the USASDC. Rather, projeer 
funding is based on a document [Ref. 2] that lists the 
WPDs in priority order and forecasts funding We, ce 
through 1994. The priority listing is put together 
project management personne leat both the USASDC 
headquarters in Washington and Huntsville, and is based 


on subjective guidance, recommendations, and 
information from R&D personnel involved in SbdDa 
development worldwide. A key feature of the priority 


list is that it changes according to four ditteveus 
budgveting ~Straresgiece. USASDC planners realize (iis 


ie 


Sueribetunding for the SUI is subject to congressional 
debate and approval, and it is difficult to predict the 
approved funding level for politically controversial 
programs. Therefore, budget planners have identified 
the following funding strategies: 
ile Core — the level required to provide a high 
Peso ime tne kage 1990" s. 


eaeebaste — the level reqm@ired@to provide a 
reliable FSED in the late 1990’s. 
3. Enhanced - the level required to provide a 


toa reontonOerm 1995. 
foaeextenaed — the level required to provide a 
Roman tecmntotwein thesearly 1990's. 
Vanulewlarivenoteworthy is the fact that the core 

and basic funding levels are not sufficient to meet the 
short term goal of an FSED in 1995; the enhanced and 
extended levels are the desired funding levels for the 
USASDC. <A consistent long term funding strategy is not 
ieee ly to be adopted by Congress in the near future, so 
Poa 50C planners must be flexible. 


C. PROJECT FUNDING GOALS 

Saourredmeariierein “this chapter, the long range 
goal of the SDI is to ultimately develop a high 
technology defensive shield against hostile ballistic 


missile attack. ine “shortmiranece goal is to reach the 
Poom not later than 1995. Progects sce lected. tor 
development, or continued development, must support 


Piese two goals. Specifically, projects should exhibit 

maeetOllowing characteristics in order to contribute to 

the attainment of short range and long range goals: 
Maximize military effectiveness 


fee Minimize project development risk 
ao. Minimize project development time 
4. Maximize project development balance 
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The next four sections will discuss these desired 
sub-goals and the factors that influence the attainment 
of these goals. 

4 Maximize military effectiveness 

A project will not be selectéd fora unde 
unless it contributes to the achievement of the ocverawm 
military mission of the SDI. There are three ways in 
Which a project can make such a contribution. The 
first is that the project can augment the achievement 
of the long range goal of the SDI; the project can 
assist in a defense against attacking ballistic 
missiles: This defense must be designed to destroy ise 
many hostile missiles that an aggressor will be 
deterred from launching them. The degree to whiiciia 
pre vec L aids thie survivability, destructibiivags 
supportability, and/or reliability of the SDI defensive 
system is a critical characteristic that musta 
evaluated prior to funding decisions. 

The second manner in which a project can 
contribute to the military effectiveness of ‘thew 
program concerns the SDI short-range goal; the projeco 
can support the achievement of an FSED by 1995. .4n 
informed FSED will require a great deal of technical 
and tactical information. Many projects perform R&D 
tasks that are designed to support the FSED, soa 
project’s potential contribution in this area must be 
concidered. 

ae final cOnSsSELtiveme of military 
effectiveness involves the potential generation of 
military spinoff technology. Military spied 
technology is a technological advance that benefits 
military objectives other than those associated with 
the SDI. For example, advances stimulated by an SDI 


research project on space target hardening would 
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foriatiivwmaebemecarihea Over ~to ground and sky target 
forces proj,Eects not be related to SDI. The space 
program of the 1960’s and 1970’s led to a great many 
technological breakthroughs that benefitted many other 
facets of the military world; one would expect the SDI 
program to similarly induce useful spinoff technology. 
The potential for generating additional military 
benefits is a project characteristic that must also be 
considered prior to funding decisions. 

To summarize, the three components of the 
military effectiveness goal are: (1) maximize the 
potential contribution to the SDI long range goal of 
building a missile defense system; (2) maximize the 
merential contribution to the SDI short range goal of 
reaching an FSED by 1995; and (3) maximize the 
potential generation of military spinoff technology. 

rei Minimize project development risk 

Each project in SDI has a degree of risk 
associated with it; some projects are more likely to 
achieve success than others. It is advantageous to any 
financial strategy to fund projects that involve the 
least amount of risk. There are two separate types of 
risk that are associated with each project that must be 
considered during the funding process: technological 
risk and milestone risk. 


Many projects require the development of 
radically new technology, whereas others involve 
established and proven scientific ideas. Technological 


risk addresses the technical or scientific uncertainty 
affiliated with each R&D project; the likelihood of 
failing to meet the ultimate technical objectives of 
the WPD. A venture that relies on the development of 
unproven technology in order to achieve its goal poses 
a risk to the SDI investment scheme. The technological 
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risk must be considered prior to making Sa funda 
qdecision rescardinge ay prejecm 

Milestone risk involves the milestone schedule 
that is listed in each WPD. Projects aré siven targes 
dates in which to reach certain developmental plateaus® 
Milestone risk is the likelihood of failing to meet the 
target date schedule specified in the WPD:; thie )riciaee 
critical to the overall success of the SDI, since mang 
projects are interrelated. 

It is important to differentiate the two @igwae 
of risk involved with SDI. A project might have a very 
low technological risk, but represent a high milestone 
risk if it depended on the performance of tasks that 
are technologically easy, but operationally difficmim 
The two components, therefore, of the goal to mimi. 
risk are: (1) minimize technological risk; and 28 
Minimize milestone risk. 

ons Minimize project development tin. 

The third major desired characteristic Ofgem 

SDI project is that it should minimize project 


development time. There are two constituents) of 
project development time. The first concerns the time 
required to achieve ultimate project success. SDI 


projects demand varying lengths of time in order to 
accomplish the goals of the research. It is difficuiee 


to Tpredict the time required for many  projiecrmas 
particularly those that in Ole new technology. 
Nonetheless, the estimation and minimization of this 


time is important, since the missile threat poseama 
Warsaw Pact countries is becoming increasingly 
sophisticated. It does not make sense to spend money 
on a project that would require an excessive amount of 


time to properly research andw@deyc horn 
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The second facet of project development time 
that should be considered in project funding decisions 
Pm Ele ulMesredquinreda to -aehieve the project objectives 
needed for an FSED. The desire to reach an informed 
FSED by 1995 (the short range goal of the SDI) has 
already been discussed. The FSED requires information 
on the feasibility of each project. The time required 
to conduct UmMemIe Seat hl needed to provide this 
information will vary. Many projects that involve 
proven technology can be expected to achieve the 
project objectives needed for an  FSED very quickly, 
whereas other projects will contribute to the FSED 
Slowly. Projects that need a short time to perform the 
required FSED research should be encouraged. 

The two sub-goals of the minimize development 
time goal are as follows: (1) minimize ultimate project 
success time, and (2) minimize FSED contribution time. 

4. lMaximeze Jpme | ecctmdevelopment balance 

A balanced research and development SDI 
program is a theme that has been expressed repeatedly 
in the USASDC 1986 Report to Congress [Ref. 1] and by 
key leaders in the USASDC. The 1986 Budget Priorities 
briefing [Ref. 3] lists four elements of the Balanced 
Technology Program (BTP): technology base, concepts and 
designs, data collection and signature measurements, 
and function performance. It is desired that a proper 
morance of funding to these research elements be 
achieved and maintained. 

Technology base scientific work encompasses 
work that is both basic and applied research. Some 


technology base efforts involve relatively 
straightforward extensions of existing technology; it 
also includes high risk, high payoff efforts. The 


technology base program is intended to foster the birth 


Ia 


of Many innovative wmacace It is important that enough 
projects in this category are supported so that) thes a 
program continues to develop new technology and does 
NOt, stagnate. The work done in the technology base 
phases are refined in the concepts and désigns rescearen 
phase. specific ideas regarding problem solutions sang 
equipment designs are formulated in writings anda 
experimental procedure is postulated. Data collection 
and signature requiremenines involve proof-of- 
feasibility experiments to support or refute the ideas 
stated in the concepts and design phase. Many projects 
in this category are critical to the goal “oteag 
informed FSED by 1995. The function performance phase 
involves experiments that ‘demonstrate the capabilities 
of the project. This is the last phase prior to 7. aa 
Secale Cevevo pinen rt and deals with technology that has 
already been demonstrated as feasible and must now be 
integrated with other system requirements. Functter 
performance experiments tend to be expensive and tai 
consuming. 

The goal of promoting project developmenge 
balance will be achieved by maximizing adherence to the 
guidelines shown in Table 1. 


TABLE 1 
BALANCED TECHNOLOGY PROGRAM 


Category Guidance Fiano 
Technology base 35% 28% 
Concepts and designs 5% 8% 
Data collection 10% 7% 
Function performance 50% 57% 
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III. LITERATURE REVIEW 


The past twenty years has seen a great deal of 
“rieyilemactiviiy in the area of project management, 
and the aspect of research and development project 
funding has been modelled in a variety of ways. it: Ls 
Pies intent of this chapter to provide a current 
assessment of the literature addressed to quantitative 
models of research and development project funding. 
The four general types of project funding models that 
will be discussed are subjective models, risk 
assessment models, financial models, and mathematical 


programming models. 


A. SUBJECTIVE MODELS 

The simplest form of formal R&D project evaluation 
involves subjective models. The subjective models that 
are used the most frequently are checklist and scoring 
models. Liberatore and Titus [Ref. 4], in their 1985 
study of 29 Fortune 500 firms, found that almost half 
Gof the 29 firms had used checklist and scoring models 
to help manage the R&D project funding process. 

The checklist involves the completion of a profile 
far: £or each project being considered for funding. 
frteria are listed on the checklist which are believed 
to be important factors in determining the eventual 
Success or failure of the R&D effort. Each candidate 
project is rated according to a subjective scale such 
as yes/no or advantage/neutral/disadvantage. The 
opinions of several individuals can be summarized ina 
checklist by averaging their opinions. 

Checklists are simple and easy to use while still 
providing some structure to the decision making 
process. This methodology lends itself readily to 
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types of information that are awkward or dit? feu 
include in more formal model construction, such as 
social impacts and environmental concerns. Particulas 
weaknesses of certain projects are identified) quieme. 
by their poor ratings on certain checklist criteria 
The checklist procedure is particularly useful in time- 
constrained decision situations. 

While the ease of the checklist model is desirable, 
it can also be dangerous since critical problems naa 
overlooked. Complicated relationships are not easily 
imcCOorDoOraved aio such a model. Although many 
important factors may be included in the model 
relevance or weight of each individual factor or 
pro vect- is Not “captured: 

The scoring model is an attempt remedy this prebikew 
by assigning weights to individual criteria ane 
summarizing the results in a single project scomee 
Decision makers are required to state their preferenmae 
in order to obtain a set of criteria Were. 

several methods have been developed for deriva 
these weitonts. These include simple rank-orderingaes 
the criteria and various types of paired comparisons. 
Souder [Ref. 5] demonstrated that increasing the number 
of scoring intervals improves the accuracy of the 
model. However, psychometric testing has shown that 
nine is the maximum number of intervals that should be 
used. 

In 1969, Moore and Baker [Ref. 6] conducted a study 
comparing scoring models with more sophisticated 
economic, risk analysis, and optimization models, and 
the scoring models fared well. Using standardized 
data, the scoring models they tested produced results 
that were 90 percent rank order consistent with 


economic and optimization models. The analysis was 
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Minttedmetouvonly Live Criteria, but it does suggest that 
a scoring model can be a useful tool when the 
complexity of more sophisticated approaches”) are not 
Justified on the basis of time and cost. 

Excellent examples of scoring model applications to 
R&D project funding have been presented by Moore and 
Baker [Ref. 6], Gargiulo and Hannoch [Ref. 7], Motley 
and Newton [Ref. 8], and Dean and Nishry [Ref. 9]. 

The major disadvantage with the scoring model is 
Piateit is dimensionless, thereby limiting its use to 
rank order comparisons. Such comparisons provide 
information on the ordinal scale, when often times R&D 
managers desire data concerning projects on a ratio or 
interval scale. Another problem is that there has been 
little analytic activity and very few applications of 
scoring models in recent years, indicative that other 
models of project funding are now more preferable than 


Subjective models. 


B. RISK ASSESSMENT MODELS 

Many civilian firms have shown a proclivity towards 
using risk assessment techniques to make project 
funding decisions. Liberatore and Titus found that 35% 
of the respondents in their study were familiar with 
either decision tree models or Monte Carlo simulation 
models, the two risk assessment methods’ that are the 
most important and applicable. 

Decroton trees models attempt to focus on the fact 


that many R&D activities are actually ae series of 


interrelated projects. The benefits that are gained 
via the successful completion of one project will 
affect the outcome of the other ventures. Decision 


meees have been used extensively to help in the 
characterization of project funding decisions. 


Zed 


The procedure is to establish decision pom ae aee 


nodes graphically and to determine branches emanating 


to and irom eachw node Each branch or path has a 
certain outcome and risk associated with it. For 
exalplre, consider a project which might Have twee 


ditterent funding stratecmece If given strong support, 
the chances that the project might produce a item 
successful outcome might be .8, and the chances of a 
moderate Success m are yc However, if the projcéctme. 
given only weak support, these respective probabil l/ijgiee 
of high and moderate success might change to .6 and .4 
respectively. The decision tree model is )b)0]j=a 
formalizing all such outcomes’ and probabilities. The 
optimum path is found by starting at the right-hand 
side, and by following an expected value algsorienmm 
folding back to the starting point. At each node the 
expected value is calculated for all the branehee 
leaving that point, and the path with the hHigheey 
ExXPeecved 9 Vale Louece lec ven. Projects are “tite 
interrelated where appropriate and an entire networmmaes 
decision trees are connected to model the complete 
project funding process. 

This method is analytically simple and can be 
graphically represented, so the basic logic behind the 
tree structure can be easily communicated to high-level 
managers. It has been demonstrated as very useful 
making decisions concerning projects when the number of 
projects being examined for funding are small angie 
interrelationships are not excessively complex [Ref. 
Ole 

Raiffa [Ref. 11] and Jackson [Ref. 12] have both 
demonstrated that the decision tree model can be 
successfully applied tea. R&D projec funding 
situations. ee major drawback of this model concerns 
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the fact that outcomes at each node are represented by 


oe i 


aerew points rather than a continuous distribution of 
epee a 


possible outcomes. Adding more branches to the nodes 
provides better representation ot the underlying 


mprebability distribution, but the complexity of the 
calculations involved increase rapidly. Any user of 
fers technique must be willing to accept the tradeoffs 
between accuracy and computational difficulty/expense. 

The Monte Carlo simulation model is based on the 
Mecision tree model. Each of the nodes is replaced 
with a probability distribution and this produces a 
stochastic decision tree. This is analogous to adding 
an arbitrarily large number of branches to each 
decision point. 

The Monte Carlo technique generally provides a more 
accurate description of the R&D decision process and 
offers a better basis for making project funding 
decisions than other methods. The complexity of the 
projects are displayed in a concise manner and the 
stochastic nature of the uncertain outcomes of R&D 
projects are recognized. Hespos and Strassman [Ref. 
13] are responsible for the most renowned application 
of Monte Carlo to an R&D project selection and funding 
eeenario. 

The cost of the improvements bought by the Monte 
earlOo model is that there is a dramatic increase in 
information requirements. The probability 
distributions for each unknown research project outcome 
must be estimated, and this is difficult and costly in 
most instances. 

Perhaps the most important methodological 
shortcoming of the two risk assessment models presented 
mere is that neither method deals with resource 


constraints. These methods assess risk probabilities 
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as 


but fail to allocate scarce resources amonp Treseares 
activities. A user of a risk assessment model would 
most likely be someone more concerned with finding the 
combination of projects that offer the higsgnest change. 
of ultimate R&D success, rather than optimizing the use 


of funds or project resources. 


C. FINANCIAL MODELS 

The Liberatore and Titus study concluded tmag 
financial models experience heavy use and have a high 
perceived impact in the business world today, as 62% of 
the firms they studied reported using financial proejegs 
funding techniques. The major financial mode 
technique used in the project funding process are 
Benefit Cost Ratio models (sometimes called Economic 
Index models). 

Costs and benefits associated with each project are 
assessed in terms of dollars in the Benefit’. Cost Ragas 
model. Costs are the total resource COStsaiaa 
supporting the research project or group of projects, 
and benefits are the net earnings to be realized from 
the project once it is successful (or if it is 
successful). These costs and benefits are expressed as 
present values using an appropriate discount rates et 
the ratio of benefits over costs is less than Or jequae 
to one, there is no reason to undertake the R&D 
PrOVveet. 

The benefit to cost ratio can be easily expanded to 
include probabilities of success of the project at 
various stages of development. Olsen [Ref. 14] used 
the following Benefit Cost Ratio calculation ina 
project funding study: 


Vos -----------------=----- (3-1) 
total projec cCuser 
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ine OusitoOnme ty se presents the economic value of 
Miemparoyect, Ss is the annual sales volume derived from 
Mice proe|/ect if the project succeeds, and p is the 
Buide poer Unit. The product’s @expected life span is 
meprpesented Dy nh, and r, ad, and m are the probabilities 
of research, development, and marketing success, 
mespectively. 

The ratio in equation 3-1 captures the risks 
involved, and could be augmented to include noneconomic 
considerations. Social, environmental, and political 
costs or benefits can be added to either the numerator 
or denominator of the ratio, but they must be expressed 
in dollar units, as are the other factors. 

Various project iterations can also be taken into 
mocount with this model. For example, successful 
Pompletion of a project may result ina product which 
Will perform the same function as an already existing 
project or another one under development. In sucha 
case, one would reduce the project benefits by the 
expected loss in earnings from sales from the displaced 
product. 

Benet lie cOSE ratio models are desirable in many 
Situations since they overcome the dimensionality 
problems’ of scoring models and checklist models. 
Meeision makers are required to clearly quantify their 
Pewaiuation of a project. The favorable result is that 
difficult issues cannot be avoided through the use of 
arbitrary scales, as the benefit cost ratio has an 
absolute interpretation. This allows preject rejection 
decisions that do not involve unnecessary cemparisens 
with other projects. 

Gearing and Adams [Ref. 15] and Seuder [Ref. 16] 
explain how the benefit cest ratie medel might be 
applied to an R&D project funding medel. Keefer [Ref. 
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17] and Costello [Ref. 18] are more recent proponents 
or the benef vt cose medeim 

One problem with this type of financial model is 
that the information required is often times very 
Gttit cult) GOwmee >) tame The probabilities and cost and 
benefit estimations usually require a considerable 
degree of experience on the part of the analyst ances 
historical precedent. It is also difficult to Gxppeee 
many noneconomic effects in dollar terms, especially in 
military project funding eLrorrtce 

Another shortcoming with the benefit cost R&D 
project selection and funding technique is that benefit 
cost ratios are not useful when evaluating the 
consequences of alternative funding levels. Each 
element in the ratio must be reassessed if the fungage 
level is increased or reduced. As with risk assessment 
models, benefit cost models do not recognize resource 
constraints. There is no way of quantitatively 
limiting a particular resource at a certain amount, or 


forcing the model to perform to a specific level. 


D. MATHEMATICAL PROGRAMMING MODELS 

Mathematical programming models have been used 
extensively during the last quarter of a century to 
solve many allocation and capital budgeting problems. 
Surprisingly, the Liberatore and Titus study found that 
there was no usage of mathematical programming for R&D 
project funding in the firms that they investigated. 
However, that fact has not precluded many optimization 
proponents researching new project selection and 
funding models. The branches of math programming that 
have seen the most activity in this area are linear 
programming, nonlinear programming, integer 


programming, and goal programming. 
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The technique of linear programming is a well known 
and useful one. Project funding models such as those 
proposed by Asher [Ref. 19] and Hanssman [Ref. 20] are 
formulated in the general form shown below: 


maximize >> CX (3-2) 
subject to >, AX <=B (3-3) 
O <= X <= 1 (3-4) 


X is an n-component vector representing the funding 
levels of the projects, C is an n-component vector 
representing the contribution of the various projects, 
B is an m-component vector representing resource 
levels, and A is anm x n matrix representing resource 
usages of the projects. 

The primary advantage of linear programming, and 
all mathematical programming models for project 
funding, is that modelled situations can be forced to 
meet resource constraints as the program seeks to 
maximize the objective function. 

The linear programming formulation shown above 
allows the project to be funded at a maximum level when 
X = 1, or any level down to XK = 0, where the project is 
not being funded. Of course, this model requires that 
a linear assumption be made concerning the resource 
constraints; the changes in X motivated by changes in B 
are assumed to be constant. 

In many situations projects are either selected for 
development and full funding, or they are not selected 
at all. Many authors have proposed integer programming 
formulations in which the X’s can only take on values 
of zero or one. Wiengartner [Ref. 21] was the first to 
propose the following formulation of integer 
programming project funding models: 


aa 


Find X = Xj, Xo, ...-, A, SO 48 UOema ie 


DUR; Xj (3-5) 
SUD )JCec te LO: 
QUA; X4 <= By ee (3-6) 
where: th 
one Pit Se eu program is selected 
J OSs tne jth program is not selected 
Rj = return Of prorgranwes 
Aij = budget consumed in year i by project j 
B; = amount of total budget available for year i 


The above formulation allows the decision maker to 
select a subset of projects from among a given, finite 
set. The objective is to maximize the rétunnia 
benefit from these programs while continuing to satisfy 
budget limitations or any other resource constraints. 
The end result in this instance is that the decision 
maker will be provided the list of projects that he can 
support at the fully funded level, given ite 
constraints that have been placed in the pregrane 


While many fume t Lema relationships in a 
mathematical model of the project funding process may 
be linear annette others are more realisticame 
described by Nonlinear relationships. Numerous 


researchers began work on a project funding model 
thinking that a constant change of one variablewm 
response to another was appropriate, only to discover 
that such an assumption was false. 

Nonlinear programming models are very similar in 
structure to linear models; the only difference is that 
the constraint equations, objective function, Or =ie@ms 
are nonlinear. If the model builder has enough data to 
support nonlinear equations then there 1S nO reason 
make the standard linear assumption that the vast 


majority of project selection and funding models make. 
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An excellent example of a nonlinear approach was made 
by Taylor, Moore, and Clayton [Ref. 22]. They 
identified over twenty nonlinear relationships for 
inclusion in their model. For instance, they were able 
BOmestate that the probability of success of a 
particular project increased according to the amount of 


money that was spent on it, but at a decreasing (rather 


than a constant) rate. A perfectly acceptable 
methodology is to initially make the model linear and 
make applicable nonlinear modifications as more 


information becomes available. 


Einear, fmceger, andesienlinear “project funding 
models all have weaknesses. Linear models are too 
simplistic for some project selection situations. 


Since resource utilization as well as the project 
funding level can be used as decision variables, a 
strictly O-1 integer program can be overly restrictive. 
Nonlinear programs usually require considerably more 
information and research than linear models. 

The most’ serious shortcoming of these mathematical 
models is that they are restricted sto the consideration 
of only a single objective function. In most real- 
world situations, however, there are usually several 
objectives that are desirable to the decision maker. 
In 1961 Charnes and Cooper [Ref. 23 | introduced the 
concept of goal programming as an attempt to recht fy 
this problem. _ — _ 


Goal programming is a modification of linear 
programming that allows multiple goals or objectives to 
menmoptimized in the model. The decision maker is 


required to rank in an ordinal manner the goals 
established for the organization. In a linear program 
a single criterion is optimized directly, whereas in 
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goal programming the deviations from the exac# 
satisfaction of the goals are minimizea 


The formulation can be expressed as follows: 


Minimize: PGs cl (3S 7_ 
Subject yuo: >, Gx + d~ - dt = g (3-8) 
> Ax <= b (228 

d-; d*, xX =a0 (3-10) 


The variables shown in equation 3-7, d™ and dt, 
represent the negative and positive deviations from the 
goal constraints to be achieved (equation 3-8). These 
deviations are also referred to in goal programming 
IPterabure as underachievement and overachievement 
variables. Equations 3-9 and 3-10 are typical linear 
programming constraints regarding resource availability 
and non-negativity. Note that equation 3-8 is not an 
inequality constraint Dats contrary to most 
mathematical programming techniques, is an absolute 
equality  stavemnenc. This is intended to placemat. 
deviations from the goal constraints into the deviation 


variables. 


The goal programming project funding model has 


proven to be very flexible and popular. The basic 
methodology can be modified to include nonlinear and 
integer constraints. Charnes and Stedry [Ref. 24] 


wrote a linear goal programming model that broke the 
project selection process into short run and long run 
funding strategies. Salvia and Ludwig [Ref. 25] 
modelled the project funding process at the Lord 
Corporation using a goal program that optimized the 
attainment of ten goals involving 25 projects. Ignizio 
[Ref. 26] created an integer goal programming project 
funding model for the US Army Ballistic Missile Defense 


Agency, and a general integer model was written by 
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Winkofsky, Baker, and Sweeney in 1981 [Ref. 27]. 
Nonlinear programming was recently added to the list of 
sucecessi ul modifications to the general goal 
programming algorithm when Taylor, Moore, and Clayton 
published their integer nonlinear goal program project 
funding model [Ref 22]. 


Bee PREPERRED MODEL 

In this chapter the four major model types for 
beoject funding have been discussed: subjective 
models, risk assessment models, financial models, and 
mathematical models. Though each model type is 
important and useful in many situations, the goal 
programming model for project funding in the 
mathematical model category is the most applicable to 
the project selection and funding scenario for the US 
Army Strategic Defense Command. This is true for 
several reasons. First, the goal programming algorithm 
allows the use of resource constraints, a very critical 
feature since the SDC is concerned with limited funding 


resources. second, goal programming permits’ the 
decision maker to specify multiple objectives or 
targets to be achieved; as discussed in the previous 
enapter , there are several goals at issue here. 


Finally, in the last decade goal programming appears to 
Mave been established as the preferred method of 
solving the pPro7,ect i Glen is © 1kem, Numerous 
applications of goal programming have been made to 
scenarios not too dissimilar to the one facing the SDC; 
m@esarticles written by other goal programmers will 
maaoubtedly assist project selection efforts in this 
endeavor. 

For the reasons just stated, goal programming will 
be the principle tool used in the project funding model 
momope discussed in the remainder of this thesis. 
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IV. MODEL DEVELOPMENT 


The goal programming technique requires iii 
development of mathematical equations to represent 
model goals and constraints. In the second chapter the 
four major project funding goals for the USASDC were 
introduced. These goals are reviewed below: 

1. Maximize military effectiveness 

a Minimize project development risk 

3. Minimize project development time 

4 Maximize project development balance 


It is the intent of this chapter to determine a 
methodology for converting subjective judgments of 
individual project contributions to the major eeu 
project goals into coefficient weights. These wedi 
Wild “Representa che performance of each projegeE 
regarding each goal or constraint equation in the GP 
model formulation. 


A. TRADITIONAL METHODS OF QUANTIFYING SUBJECTIVE 
JUDGMENTS 
A key problem in the project funding modelittg 
process involves the quantification of subjective terms 


such as effectiveness, risk, time, and balance. The 
USASDC does not have atable or document that lists 
values of funded projects in such broad terms. The WPD 


for each project lists funding authorizations aa 
milestone objectives, but it does not include a score 
for effectiveness, risk, time or balance. Projéeécer 
selection and funding decisions are largely based on 


the subjective opinions of key personnel involved with 


each project, especially the program element managers 
assigned to the USASDC headquarters. Operations 
research Ipieive G Ubicce contains several traditional 
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methods for quantifying intangibles, a task that must 
be performed so that coefficient weights for the GP 
medel can be determined. 
i Numerical Rating Method 

A VieTny, simple method for quantifying 
SUMTectLives judgments is the numerical rating method 
(sometimes called the magnitude estimation method). 
This method was first proposed by Stevens [Ref. 28] as 
a method of elec dat comparative rankings in 
psychophysical experiments. Judges are given two 
reference points and asked to associate the rated items 
with these points. This can be done either by using 
numbers, or by plotting points on a continuous number 
line. When using two reference points, one can imply a 
Senstant interval scale. For example, in a project 
funding scenario, a program element manager might be 
asked to rate the potential technological payoff of two 
proevjects. The manager could perform this task by 
micbmeating where these projects fall on a continuous 
mene, reterenced by a prepositioned project with low 
payoff and another with high payoff, as demonstrated 
mellow in Figure 1. 






wn 


low payoff proj 1 high payoff proj 2 
project 


Figure 1 - Numerical Rating Continuous Line 





ihe researcher could then use these intervals 
meme Getermine the scale relationship of these four 
projects. Since this results in interval scale data, 


the points can then be linearly transformed to any 
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other scale desired; a common scale would be |) the 0-100 
S Cave 

ihe or inary advantage of this method is 
computational simpilitel ry. Basic statistical work can 
be performed on the results, and one Can easilyepeee 
for sigsniticant ditiecrpenmecs- Unfortunately, problems 
often arise when determining the reference perme 
there is no natural origin and judges frequen, 
disagree with the reference point positioning. (ia, 
researchers also have difficulty with the ) laezaa 
bounds on the interval scale. 

ate Categorical Judgement Method 
A commonly used means of obtaining numerical 


results from subjective ratings is the catesormeeam 


judgement method, wherein judges assign instances to 
ranked categories. For example, pollsters often ask 
people to rate political candidates as poor, ifa35@ 
average, food, Or Outs tandinse. Program managers could 
Similarly be asked to rate project milestone risk 
according to a scale of very low, l1OW, average, hie 
Or Very nae Dyer, Mathews, Wright, and Yudowticea 


{[Ref. 29] recommend that five categories be used for 
tilts techniaue. 

The procedure begins by rating the tUCeieaeae 
question and then arranging the cumulative fréquence 
data in a matrix of n row instances and m column 
categories. The elements of this matrix are treated as 
areas under a standard normal curve and are converted 
to the corresponding Z values. These values are then 
recordedijim a 243 matrix consisting of n rows and m-l 
columns, since the last column may be omitted for 
computational purposes. The row and column averages 
are computed, and called Rj, and C respectively, and 
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the grand mean, G, is calculated. <A row sum-of-squares 


term is computed as shown below: 


SSC = aa (Gc (4-1) 

For each row, the following is computed: 

SSR; = 4 (Z44 - Ry)? (4-2) 

inemsea le Vanes Sotewtiecr=instances, 9 9S,, are 


found by solving the following equation for each row: 
>4 = G - Zi * SORT (SSC/SSR;, ) (4-3) 


In equation 4-3, S represents the interval 
scale value, G is the grand mean of the Z matrix, SQRT 
represents the square root mathematical operation, and 
SSC and SSR are the column and row sum-of-squares. 

The categorical judgment method succeeds in 
obtaining an interval scale value that can be linearly 
transformed to any other scale. Lt eis smote 
sophisticated than the numerical rating method, but 
still computationally easy. Questionnaires employing 
this technique are straightforward and uncomplicated. 
The major drawback with the categorical method concerns 
the five-category limitation; this is not accurate 
enough for most serious efforts to quantify subjective 
evaluations. 


o. Least Squares Method 
Meetiacduent “pirecedure for eliciting expert 
Opinion is that of asking judges to do some form of 


Ordinal ranking of various instances of a designated 


property. The Least Squares Method was first proposed 
by Guilford [Ref. 30] as a means of obtaining scaled 
interval data from ordinal judgments. The procedure 


has proven very useful and relatively simple. 


35 


The method is initiated by Soliciipinewaa 


ordinal responses of the judges comparing several items 


on the basis of a particular factor or quality ..ee8 
Cx eee rel ers mi snus be asked to rate several 
television shows as excellent, good, fair, oOr@poeem 


Suppose that a judge feels program B is better than 
program C, which is better than program A. Tallies 


the taj matrix would be made as shown in Table 2. 


TABLE 2 
LEAST SQUARES METHOD SCORING PROCEDURE 


Since B is the preferred show, oné S0es Tome 
B column and makes entries in the columns’ that were 
rated inferior to B, which in this case were columns A 
and C. Likewise, an entry is make in the C column gang 
A row. The responses from all the judges are tallied 
in this manner and collected ina Pij frequency Matias: 
like the one shown in tabte s. 


TABLE 3 
LEAST SQUARES METHOD FREQUENCY MATRIX 


fj. ne Bo a 
x 28 46 
B oP 65 
C 54 35 
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Note that the cross-diagonal elements each sum 


to the total number of judges; for this example there 
were 100. The next step is to convert the eG matrix 
to a probability matrix, Pij- This is done according 


to the equation shown below. 


Pi; = Pij / (f4 5 st: fii) (4-4) 


To continue with the example, the probability 
matrix in Table 4 was obtained. 


TABLE 4 
LEAST SQUARES METHOD PROBABILITY MATRIX 


It is important to note that the diagonal 
constituents of this matrix are set equal to .5 and 
values in each column are added to obtain column sums. 
Prooability matrix entries greater than .98 and less 
than .02 are omitted in order to avoid numerical bias. 
The Pi; matrix is then converted toa Zi 3 matrix of 
standard normal values. In our example, the Zij matrix 
ms Shown in Table 5. 

The sought-after scale values are equal to the 
column sums of the Zi 3 Maat td, As in the categorical 
judgment method, these scale values are linearly 
transformable. The least square procedure has the 
advantage of requiring a relatively low level of 
ordinal assessments, so data collection surveys are 


simple. Judges are not asked to make lengthy pairwise 
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TAB EE aso 
LEAST SQUARE METHOD STANDARD NORMAL MATRIX 


zig | A Be 

A 0 =. 983 ee OO 

B 583 0 -.385 

C 100 385 0 

Sums | .683 -.198 .285 
Comparisons: rather, they simply list the instances in 
what they believe is the correct order of importamee 
regarding the compared factor. This method is not 
appropriate for use in the project funding model being 
developed here, however, because it requires a Pawge 
number of judges. Many expert opinions must be 
collected gathered in order to make a probability 
matrix as described above. In the USASDC there are at 


most three experts in each program element management 
shop, and this is not sufficient to employ this method 
effectively. 
4. Constant Sum Method 

The Constant Sum Method is a technit@me 
developed by Comrey in 1950 [Ref. 31] that quantifies 
subjective ratings based on pairwise comparisons. 
Judges are asked to consider each possible pair of 
instances, and within each pair, split 100 points. 
Thus, for each judge with n instances to >be seatecs 
:n(n-1)/2 pairs must be considered and 100 £4xpoints 
divided between each. The largest number is’ given to 
‘the member of the pair having the greatest amount of 
the property being considered. The computational 
procedure begins by creating a comparison matrix, with 
the cross diagonal elements summing to 100 points. 


This matrix is then averaged, depending on the number 
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Hagges, ane a Wo omatrix is obtained by dividing each 
element by its respective cross-diagonal element. The 
Pip roducts are multiplied by the nth root, where n 
is the number of compared items. These values equal 
the desired scale quantities. 

An example sheds further light on this method. 
Consider two judges evaluating three cheeses on the 
basis of taste. Their respective comparison matrices 


are shown in Table 6. 


TABLE 6 
CONSTANT SUM METHOD COMPARISON MATRICES 


Judge 1 Judge 2 
aij | A B C aij | A B C 
A 5 O 2Q 40 A 50 10 30 
B 80 50 60 B 90 5 0 70 
C 60 40 50 C 70 30 50 
In both instances above, the judges indicate 


that each prefers cheese A to B, cheese A to C, and 
eaeese C to B, but strength of these endorsements are 
merrerent. The next step is to combine both matrices 
by averaging the ai 5 values as shown in Table 7. 


TABLE 7 
CONSTANT SUM METHOD AVERAGE COMPARISON MATRIX 





ag 


The Wij matrix is then computed using equation 
4-5 shown below: 


Wij 7 2177 29m (4-5) 


The wg matrix for this example is shown in 
Pa hes o. 


TABLE 8 
CONSTANT SUM METHOD W MATRIX 


Wij | A B C 
A 1.00 wie 54 
B 5:67 1.00 1.86 
e 1:86 54 1:00 


The scale values can be solved for now by 


taking each column product to its respective nth YoeGm@ 


In our example, nm, Vrhe ‘numeer of cheeses being 
compared, is "32 The calculation is demonstrated in 
Tap em. 

TABLE 99 


CONSTANT SUM METHOD SCALE VALUE COMPUTATION 


S, = [(1)(5.67)(1.86)]1/3 = 2.19 
So = [(-.72)(1 )( 549) eee 
Sg = [(.54)(1.86)(1)]1/3 = 1.00 


A great advantage of this method over the 
others that have been discussed is that it provides 
quantitative values that are all on ae similar ratio 
scale, rather than the interval scale. Ratio scales 


allow not only linear transformations, but all 
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a eonmetuemo@perations. PoOrumexample, One can conclude 
that an instance with a value of 1.0 has twice the 
compared property of an instance with a .5 value. A 
problem with this method involves consistency; judges 
often cContvrad met themselves (unintentionally), 
especially when the number of comparisons is large. 
Many judges find categorical comparisons much easier to 
make than numerical ones. 

The traditional methods of quantifying 
subjective evaluations are not adequate for a project 
funding model. A method is needed that does not suffer 


from any of the major disadvantages prevalent in the 


procedures just discussed. Dae 7.3. soa ket. 32 | 
developed a method of quantifying subjective 
intangibles that is far superior ~to any of the 
traditional methods just described. He called this 


procedure the Analytic Hierarchy Process, and it will 
be the subject of the remainder of this chapter. 


Be THE ANALYTIC HIERARCHY PROCESS (AHP) 

In less than a decade, the AHP has found its way 
into many important decision-making models. Our 
investigation of the AHP will begin with a detailed 
discussion of the four-step AHP procedure that has been 
popularized by Saaty. These four critical steps in 
eenverting subjective judgments into numerical results 
Sarre Shown in Figure 2. 

peep  £§ involves hierarchic decomposition. Tine 
mesearcher must develop a logical representation of the 
factors and levels involved in problem scenario. For 
eeample, consider a person desiring to purchase a new 
macomobile. The objective of buying a car is placed at 
Bhe top of the hierarchy. BaAGHOWwsumulaw  lntLuence,) the 
fecision, such as price, comfort, and status are placed 


41 





in the 


es — 


rN gw 





oreae 
bs Teraron: ic IT 


ad oN ARS ee SS. es Pe ae 
ese, ejay get eves be AGP Ss ws: ab Nive vane eae Ie 


ot e 


Pa rl 
pie ees 


ee me Ra oe te Wi 
rye S % rs nes ee ay eee 
WP yo thse Ca te aS x ae Pr. JA tS 
x as = © i eS : 4 y 
“ ecto DN op % oy, 2m we Me ae o 
> y i a : 
BS ‘a a 








- 
a” 
- 
Mh 
eth am 
+ 4 als 3 Tye 
eee, | TPTT es Tok eae AS S 
Ase Cerra Vacs 
ENN RESO aL ES SEN aN 
eae nae Si Coe han eR Ue See Fr ie i hy Swe “cpn \ 
Je 






decsision inte 


1 ! a oe ® 


» aXe 
WIhYP) Pee 


¥ e 


© Cottect ea iri ‘e 
conmparisan Gates Foor 
















: ON 
SRAIRY oc Gia eee BA poy NRE Naar SE EE Lie RCA UA 
Sue Fe re = ae , a ‘ ‘ 
Ct ond fom , & i Fé , Pb + ’ 
eeu: LEE 3: oeiue for MaACT Ly 
WY ERG 9 


2, eI 


\ 


a4 " ous, ie 
ined 


PJOQOn vector 

















EME } : | ; 

i. area Se ctcety 5 ai eses ‘ ee eleTPR amas aes Peel BS eee Aly é 

Boe ae SAR OU AL) ate el oe ai Sf erate nade aes ean c CL fie De j I Patan onde 

© SY tet Wa Sa eater Oe a, one Nag he De Boks eg we. are ated, 02k: bemenanee 

°ae ce Ae oA ye 5 = * 

a” 6 ‘ LN >» ™ > ‘ 

Se ReRees Ge ee ope dae Snaregat E wets | 

, Bales r: i . 

‘es. RUE cay ree To u ae ee sl wr a i ad 

Caney, 

SERS BE i; a + teal | 

tet * eer Ay Ab Ay. s me ae we a ! f- pe 

EN p OEE: We: i ad 4 he & Ci " ode 2 Ses cl. | 
‘oe? Pd 


Bry eee a 2G 


Tees, 
ae tat vary, « > 
We Ree eRe os fo de js Ges .* tanh AR Re mele! aes KG eee aoa OSRAAIY & 
> Cbd ae ew A) oe 


Srp oes Att 
eh PRNRSASARS 2s LF HIGGS 


next 


Ao be Add ds har ttadidsddd DT IaAC Ouse en 


Pe Oui ee 


hierarchy 


alternatives are 


a 


step 


2, 





00% TABS A CM ve atete gate 
abe Q Geran? Pare ay! sR caine fa 85g! we sf: “anes 


pee sshtde Selim bese ae 


Die Rete Re satel a ies ebay 


At reeled et rArdd bd ae 


AHP Procedure 


— 


level, and the various car 


listed at level 3 of Figure 3. 


judges are asked to make pairwise 


comparisons of the factors at each level using the 
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pairwise comparison scale shown in Table 10. This 


maple is the result of extensive psychological 


measurement studies. saaty concluded that human 
sensory perception is capable of distinguishing only 
Mine distinct subjective performance levels. As in the 


constant sum method, N(N-1)/2 pairwise comparisons must 
Mes made, and the results are placed in a comparison 
Meerix. In the car buying example, a matrix like 
mieone Shown in Table 11 could be obtained. 

In step 3, Piemme Pemuvalue solution technique is 
employed. As shown by Saaty and Vargas [Ref. 45], the 
mmeocedure involves solving for the largest eigenvalue, 


Lambda Max. Mitieeilemmexanple .we “are concerned with, 
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TASE Ed 
AHP PAIRWISE COMPARISON SCALE 


IN Genser y 
of Importance Definitien 
il Equal contribution by both 
factors/alternatives to the property 
a One factor contributes slishtly mee 
to the property than the other 
5 One factor is strongly favored over 
thevotnet 
7 One factor is very strongly favoree 
over the other 
9 The evidence eV Ona one factor over 
the other is of the highest possi. 
order of affirmation 
2,4 ,0f0 Intermediate values 
Reciprocals If activity i has one of the above 


numbers assigned to it when compared 
toywacEl vi ty) then j has the 
reciprocal value when compared to i 


TABLE 24 
AHP EXAMPLE COMPARISON MATRIX 


Comfort Ford Chevy BMW 
Ford il 1/2 1/4 
Chevy Z it Ly 2 
BMW 4 2 1 
Lambda Max was found to be S200" The normalized 


eigenvector is then computed and is as shown in Tapas 
i. 

The AHP interprets wine eigenvector as clear 
evidence that the BMW will contribute the most to your 
comfort while operating a car, since the BMW comipoem: 
factor is twice the size of the Chevy comfort factor, 
and three times as large as the Ford value. 
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TABLE 12 
AHP EXAMPLE EIGENVECTOR 


Comfort Ford Chevy BMW 
Ford 1 2 1/4 
Chevy 2 if ee 
BMW A a 1 
EIGENVECTOR: -143 .286 571 
Ford comfort value: ~-143 
Chevy comfort value: .286 
BMW comfort value: wo 
In the simple example just described, it was 
apparent that the responses of the judges were not 
sentradictory or conflicting. However, in many 


instances the number and complexity of subjective 
judgments involved in the AHP make it necessary to 
compute a consistency ratio (CR). feiss tertumate unak 
the AHP provides a method for computing the CR, for 
this affords the user the opportunity to evaluate the 
quality of the data that has been input in the 
comparison matrices. Respondents, despite their best 
Peerorts to the contrary, are often inconsistent and 
intransitive in making pairwise comparisons. 

The calculation of a consistency ratio (CR) can be 
demonstrating by continuing with our car buying 


example. Suppose a judge felt the Ford was more 
comfortable than the Chevy, and the Chevy more 
comfortable than the BMW. The judge would be 
inconsistent if he rated the BMW more comfortable than 
meme Ford; such a response would stimulate a high CR. 
ime CR is found by first finding the consistency index 
moa). The consistency index (CI) is determined using 


equation 4-3, where N is the number of items being 
compared. 
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Lambda Max - N 
Cl = ===-==— ee (4-3) 


Ware Il. is compared to the corresponding ran@en 
consistency index (RI) shown in Table 138. The RI are 
average consistency indices for matrices whose 


reciprocal entries were drawn at random from the values 


1/9, 1/8, sac, 22 eee omen 
TABLE Gs 
RANDOM CONSISTENCY INDEX 
N 1 4 5 6 7, 8 3 10 


The consistency ratio can then be found, since CR 
is equal to the ratio CI/RI. The value of CR should be 
iG penweent or Ness: If it is more than 10 percent, the 
judgments are considered inconsistent; the problem 
Should be studied again and the comparison matrix 
Revi sed., 

Step 4 aggregates relative weights of various 
levels obtained from the third step in order (to) proecgeee 
a vector of composite weights. This vector constitute. 
the scaled rankings of the various alternatives with 
respect to the factor being studied. The procedures 
to start at the highest level hierarchy and déeUCcriag 
the weights of the factors at that level. These 
weights are then multiplied by the eigenvector at the 
next level, and new vectors are obtained. This process 
continues untitethe las@elever 

To continue with our car example, in this Ste@peieg. 
eigenvectors of price, comfort, and status would be 
combined. Suppose the buyer felt price was the most 
important factor, followed by status and then comfort. 
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This would then be placed in a comparison matrix and an 
eigenvector determined. The procedure involved in step 
4 is demonstrated in Table 14. 


TABLE 14 
CAR BUYING EXAMPLE STEP 4 DEMONSTRATION 


fevemne we loOeCiyal Ves hee =.5 
Comfort =.2 
Status =.3 
revels. Glcemva LUES ; 
Factor | Ford Chevy BMW 
Pea ce 4 4 me 
Comfort eZ . “0 
status Zz 1 ad 
Ford weight = (.5)(.4)4(.2)(.2)4(.3)(.2) = .30 
Chevy weight = (.5)(.4)+ BY soo . iy = 29 
BMW weight me 0) (0.2 (ae )( +. 3) .7) = a1 


Step 4 informs us that on the basis of the data in 
this example concerning the buyers vehicle preferences 
regarding price, comfort, and status, the BMW should be 
purchased. The Ford and Chevy are rated too closely to 
erstinguish between them. 

the AHP affords several advantages over the 
traditional methods discussed earlier in this chapter. 
mec Of the AHP allows the researcher to quantify 
weights at more than just one hierarchy level. The AHP 
fives scaled values that are ona ratio scale, and the 
AHP is the only method that provides a mechanism for 
checking on the consistency of the input data. The AHP 
meemore accurate than the traditional methods, since it 
has its roots in psychological testing and human 
sensory perception capabilities. The only disadvantage 
of this method is that it is considerably more complex. 
Mowever, the benefits gained from using the AHP far 
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exceed this drawback, since a computer program caneue 
written to overcome computational Gift temene 

The choice of AHP to quantify subjective 
evaluations has become quite common during the last 


Piven, Cans: The areas in which the AHP has been 
applied are diverse and numerous. In a 1984 book 
review, Gray [Ref. 33] noted that "...you have to 
actually try the method in some simple situatilonawes 
understand its remarkable pever.] Zahedi receniaa 
[Ref. 34] surveyed the AHP and over fifty published 
applications of AHP in twenty-seven topic areas. These 
instances included the project funding model developed 
by Johnston and Hihn [Ref. 35)]5 and the budget 


allocation models of Sinuany-Stern [Ref. 36] and Arbel 
[Red 37 ie 

The AHP is superior to the traditional methods of 
quantifying subjective evaluations discussed in ite 
chapter, and it has been successfully applilequiirs 
similar projects: These two facts lead to the 
conclusion that the AHP is the preferred techniigqucwe 
use in deriving the coefficient weights for the limeas 
equations in the GP model being developed. 
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V. GOAL PROGRAM FORMULATION 


In this chapter, mathematical expressions of the 
moals and constraints for the GP model will be 
developed. Discussions of model constituents such as 
mae aecision variables, system constraints, goal 
Senstraints, and the achievement function, will be 


included in order to formulate the GP model. 


A. DECISION VARIABLES 

The first step in the construction of a 
mathematical decision model is the determination of the 
decision variables. Decision variables are parameters 
that may be controlled and are sometimes referred to as 
meontrol” variables. These variables represent the 
items that will be optimized when solving the models 

The USASDC presently manages thirty-five WPDs that 
were categorized as "major projects" in Chapter II. 
These are projects that in FY 86 were funded at 
levels exceeding $5 million or are deemed important 
enough to warrant special attention. The major 
projects will be the focus of the model and are listed 
in Table 15. Funding for the major projects constitute 
89.8% of the total USASDC core budget level, a clear 
indication of the prominence of these projects in the 
overall SDI program. 

tire aecisitonwevarlables in the formulated model are 
the costs associated with each major project in FY 88. 
Xj is the notation used to indicate the funding level 
me aollars of the jth project. The ultimate purpose of 
the model development is to determine the optimal 
values of these decision variables. 
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TABLE 15 
MAJOR USASDC PROJECTS 


Theater Missile Def Architecture 
Archi tec tine. oe Analysis 

oC Ano et 
Battle Mgmt/C3_ Experimental Sys 
National Test Bed 
Sie Ground Sys Passive Survival Tech 
Army Power Technovory 
Advanced Materials 
CM Technology Base 
Ballistle Rance se sao 


AFOCAL Technology 

Free Electron Laser Demonstration 
Free Electron Laser Site Dev 
NPB Accelerator Technology 
Interactive Discrimination 

EW Concept Development Defn 
PB Test, Pacishinny 


DEW 


KEW eric Interceptor Expe 


set 
te Hore and Test Forum 


er/Windows/Avionics 

ulsion Integration 

Targets 

oatmospheric Interceptor yaar 


orne Optical Adjunct Expt 

cal Airborne Measurement Yan 
a Judy 

n Match ; 

l Discrimination Algorithme 
robe 

Targetus 

Fecine ay) 

ar Techno ogy 

al Imaging Radar Expt 


SATKA 


BPD POWWNRRRE RF POIWOP WNP WPDONOCP WrRWMHMW PPM 
tHaHeta ods RHOADM<0 WwW 


NNNNNNNNNN AAARAARAAA COOocoo0 mrerrt www 
MWFORPNMOOCOON WOIWWNEGN CRPROOCOO NNOINWO COMP RE 
CHOWOPUIOFON NMMOMMNMMNM OFPPONP NNOFO FPWR PN 


HrONtrOoNOY MANWIOMHR 2O 
OAS rZOCOUK FDOIDLEAWS x 


Bo SYSTEM CONST RATES 

There are two types of constraints present in most 
GP formulations, system constraints and goal 
COWsStraints. System constraints are “absoluger 
CONnStTPaAInM ise they define the feasible solution Space 
that. muse be adhered to before an optimal or 


SAtlsSiacrony solution can be considered. Goal 
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constraints are "nonabsolute” in that the program seeks 
bo satisfy such equations to the highest level 
possible; goal programming attempts to minimize the 
deviation from a prespecified level, hatwekr » tnian 
attempt to satisfy any level completely. This section 
is concerned with the system constraints involving 
USASDC budget levels, minimum and maximum project 
funding levels, and non-negativity requirements. 
alts Budget Levels 

The first system constraint is concerned with 
the total amount of money available for all of the 
thirty-five major programs in FY 88. As discussed in 
Chapter II, four different funding strategies exist, 
each one motivated by a different FSED completion date. 
Since the funding strategy for FY 88 has not been 
decided, each of the possible appropriation levels will 
be run on separate iterations of the model. Table 16 
Shows the funds that have been tentatively appropriated 
to the sum total of all major WPDs for each funding 
strategy. 


TABLE 16 
MAJOR PROJECTS FY 88 TOTAL BUDGET LEVELS 


Funding Strategy Budget ($M) 
Core 882.6 
Basic O29. 1 
Enhanced 1255.4 
pParenaded 1383.4 


An equation representing the budget constraint 
Will be included in each iteration of the model. The 
equation mathematically states that the sum of the 
project funding levels must be less than or equal to 


the total budget, and are as follows: 


o1 


Iteration” is" Al +e X2e ee oe + X35 <=" = 992Zae 
Iteration 2: Ate. X2e eee + X35 <= 1029e 
Iteration 3: Xiger AZ 4 xo + X35 <= 125508 
Iteration 4: X1 + X2 + X3 + + X35 <= 138aea 
ot Minimum Funding Levels 
There is aminimum amount of money that must 
be spent on Gach proejecteancd: for many of the major 
projects being modelled, this amount is subsStanw@aa® 


Spending on any project cannot simply cease; at least 
some money must be spent in each project, if ones 
Shut the program down. Most programs are committed to 
minimal funding levels in order to cover a varictyveen 
prior obligations such as equipment purchases, facimaer, 
rentals, and labor contracts. 

Equations for the minimum funding levels will 
be entered in the model as stewn below: 

Xi >= Minimum Funding Level for Project @ 

X2 >= Minimum Funding Level for Pro jecctm 


X35 >= Minimum Funding Level for Project. 


one Maximum Funding Levels 
Similarly, there is a maximum amount of money 
that can . be spent. onveach eer ojecm Upper bounds on 


Spending exist because USASDC program element managers 
realize that there is a practical limit to the amoume 
of money that can be devoted to single project; )2.0 
certain point additional funds could not be reasonably 
or effectively spent on the project in question. 

The maximum funding level equations are as 
follows: 

Xi <= Maximum Funding Level for ™rProj ject 

X2 <= Maximum Funding Level for Project 


X35 <= Maximum Funding Level for Project 35 
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ne Non—nepat 1 vai ty 
A goal program model Gequaires that “all 
Gecision variables be greater than or equal to Zero. 
The positive and negative deviation variables and all 


other variables used in the goal constraints must be 


non-negative. This requirement adds’ the following 
melations: 
eee ASO, PPOs, PNEG@RPOS, RNEG, TPOS, TNEG, 


BPOS, BNEG, WTPNEG, WTRPOS, WTTPOS, WTBNEG >= O 


C. GOAL CONSTRAINTS 
Goal constraints are mathematical equations that 
mepresent LB OUS: objectives of the scenario being 
modelled. In a model of the thirty-five major projects 
of the USASDC, the goal constraints will parallel the 
momr major project goals. The performance of each 
project with respect to each of these goals will be 
determined using the AHP as discussed in the previous 
elapter. Goal constraint equations do not have 
inequalities as do system constraints. Rather, the 
left hand side (LHS) of the equation is set equal to 
the right hand side (RHS), thereby forcing residual 
mares into either the positive or negative deviation 
Mmariable. 
ile’, Maximize Military Payoff 
Military payoff is based on individual project 
contributions to the following: (1) the SDI long range 
goal of building a missile defense; (2) the short range 
goal of reaching an FSED by 1995; and (3) the potential 
generation of military spinoff technology. The AHP 
Will determine a military payoff score for each project 
(P1 through P85), and this score will be multiplied by 
its respective decision variable (X1 through X35). The 
sum of these products is compared to the RHS of the 


goal constraint by using positive and negative 
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deviation variables (PPOS and PNEG). The RHS is 
intended to provide an unobtainable objective for the 
LHS of the equation; the sum of the products of the 
military payoff scores and the maximum funding level 
for each project (MAX1 through MAX385) provides such an 
objective. The goal constraint attempts to get the [Hs 
as close to this unobtainable level on the RHS as 
possible by minimizing the negative deviation variable. 
Since the RHS level cannot be reached, the positive 
deviation variable will be zero. The final goal 
constraint equation representing the maximization of 


military payoff is as stated in equation 5-1: 


(P1 * Xi) +... + (P35 * X35) - PPOS + PNEG 
(Pi * MAX1) +... + (P35 * MAXS35) (5-1) 


ae Minimize Project Development etek 


The second nonabsolute constraint that will be 
formulated concerns project development risk. There 
are two types of risk to be modelled. As discussed in 
Chapver VEt., the fine is technological risk, which 
refers to the likelihood of failing to meet the 


ultimate technical objectives of the WPD. The second, 
milestone risk, accounts for the possibility that the 
target milestones in the WPD may be violated: The AHP 


Will be once again used to assimilate these two risks 
into a single goal constraint. The equation will be 
very similar to the other goal constraints. The LHS is 
a summation of the risk score from the AHP (R1 through 
R35) multiplied by the amount of money to be spent on 
each program (X1 through X35); the RHS is this same 
risk value multiplied by the minimum funding level 
(MINI through MIN35) Since the RHS' represents an 
unobtainable goal, the residual will driven into RPOs, 
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the positive deviation variable of the formulated risk 


equation shown in equation 5-2: 


fete XL) +. . . + (R35 * X85) - RPOS + RNEG 
Cio Sida 2 ee. + (R35 * MINSS5 ) (5-2) 


on Minimize Project Development Time 

The minimization of project development time 
is the third goal to be modelled by the GP. The two 
constituents of project development time are the time 
required to achieve ultimate project success’) and the 
time needed to meet the FSED requirements. The AHP 
program will be used to develop a time factor for each 
project (T1 through T35). This value is multiplied by 
the decision variables and these products summed so 
maat they may be compared to the unachieveable 
objective. Since the desire is to minimizZe, the RHS 
should be an artificially low value derived from the 
multiplication of the time values and the minimum 
funding levels. The deviation from the goal will be 
driven into TPOS and the end result is a time goal 
equation as shown below: 


me Xi) +... + (T35 * X35) - TPOS + TNEG 
(Ti * MINI) +... + (T35 * MIN35) (5-3) 


4. Maximize project development balance 
The fourth goal to be modelled is to maximize 


project development balance. The AHP will assist in 
modelling this objective by combining the following 
four elements of project balance into one number 
between O and 1: technology base, concepts and designs, 
data collection, and signature measurements. Contrary 
to the other goal constraints, the second level AHP 
Mmeerarchical values will not be equal. Rather , Sune 


eigenvalues calculated for each balance sub-factor will 
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be multiplied by the BTP guidance values shown in Table 
A: This will ensure that each element of balance. 
given priority according to the goals expressed Dy jae 
1986 Budget Priorities briefing [Ref. 3]. This wit 
generate balance values (Bi through B35) that can then 
be used as shown above in the other goal constraimipae 
The RHS side number will be the same unobtainable 
maximum value that was used in the other maximize 
goal constraint, payori- The value of BPOS wii 
zero, and the deviation from the goal will be cCaptumed 
Dy RB NEGey, The final goal constraint for the model 
formulation is as displayed in equation 5-4: 


(B1 * X1) +... + (B35 * X35))= BReoc eee 
= (Bi * MAX1) + » . sot (BS5u MAXGoM (5-4) 


D. ACHIEVEMENS) FUNCTION 

The final step in the model development is the 
establishment of the achievement function. Given that 
there is some solution to the multiple objective model 
as represented by the goal formulations described 
above, the critical task of finding the opting 
solution still remains. The achievement function is 
designed to perform such a task by minimizing the eam 
deviation variables. 

There are  eigsht ‘deviiat tem variables that are 
included in the GP model, a positive and negatwe. 
deviation variable for each of the four ~g@a 
CONStraints. Goals one and four are maximizing goals, 
so variables PNEG and BNEG will retain the goal 
deviations that are to be minimized. Likewise, goals 
two and three are minimization equations, so RPOS and 
TPOS are included in the achievement function. 

If the four goals were considered equal in rank or 


importance, the LHS of the achievement function would 
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consist Outs a summation of the Tour deviations. 


However, the goal constraints for this model of the 


thirty-five major SDI projects are not equal in 
mriority. Maximizing payoff is the most important 
goal, and maximizing balance is the lowest priority 


objective. The AHP will determine the magnitude of the 
meereLencess) DeEetLween = tne “Tour “goal constraints; this 
masnitude will be reflected in weight values for each 
goal equation between O and 1. The LHS consists of the 
sum of the product of each weight value (WTPNEG, 
WTRPOS, WTTPOS, WTBNEG) multiplied by its respective 
deviation variable. The LHS is set equal toa single 
variable, DEVIATION, and minimization of the RHS value 
will determine the optimal solution. The achievement 
function is as displayed in equation 5-5. 


(WTPNEG * PNEG) + (WTRPOS * RPOS) + 
(WTTPOS * TPOS) + (WTBNEG * BNEG) = DEVIATION (5-5) 


E. THE GOAL PROGRAM FORMULATION 

The final formulated GP model encompasses’) all of 
the equations described above andis as shown on the 
Mext page in Figure 4. 


F. MODEL ASSUMPTIONS 

There are several assumptions that are being made 
for this model, situations that are assumed to be true 
in order to simplify the model and make it solvable. 
The negation of any of these assumptions invalidates 
the model developed above. 

The first model assumption is that all equations in 
the GP model are linear. This is the most important 
assumption, since it allows a great simplification of 
the data collection process and model formulation. 
Linearity is assumed because there is not enough 
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Achievement Fureraaen 
Minimize: 
(WTPNEG * PNEG) + (WTRPOS * RPOS) + 
(WTTPOS * TPOS) + (WTBNEG * BNEG) = DEVIATION 


Goal Constraints 
SUD ect “ta; 
(P1 * X1) + . . . + (P35 * X35) - PPOS + PNEG 
= (Pi * MAX1) +... + (P35 * MAX35) 
(Ri * X1) +... + (R385 * X35) - RPOS + RNEG 
= (Ri * MINI) +... + (R35 * MIN35 
(T1 * Xi) + . . . + (ESb OO X35 TPOS weenie 
= (T1 * MINI) +... + (T3835 * MINS5) 
(B1 * X1) +... + (B35 * X85) - BPOS + BNEG 
= (Bil * MAX1) + . ... + (B35 9% MAK 


System Constraints 


Mi} 4°05 = Ses = Buen 
Xt Se UN 
X2 >= MIN 2 
X35 >= MIN 35 
X1 <= MAX1 
7 <= MAX2 
X35 <= MAX35 
X1,.., X35, PPOS, PNEG, RPOS, RNEG. TPoc we aee 


BPOS, BNEG, WTPNEG, WIRPOS, WITPOS, WIBNEGS) ae 


Figure 4 - Goal Program Formulation 


information to postulate any other functional form ayGe 
can be quite certain that none of the equations above 


in reality are exactly linear, but in the absence of 
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fib COMED weCOnLrary ; linearity is assumed to bea 
close approximation to the actual curves. This is 
especially true since the solution space is being 
bounded by upper and lower funding levels, which should 
Sonctrain the model to the region where the linear 
Socumption is particularly accurate. 

The second assumption is that all variables in the 
mathematical model are continuous. This is a common 
waesumption in models such as the one presented here. 
The capability of doing integer or  noncontinuous 
programming exists and could be implemented, but this 
would only add needless complexity to the solution 
process. Assuming that all variables are continuous 
poses no major practical obstacles. 

In Chapter II, the four project goals regarding 
mayOrti; risk, time, and balance were developed. Each 
of these goals had various components that made up 
these goals, and the AHP will determine an overall 
payoff, risk, time and balance weight factor based on 
these sub-goals. The third major model assumption is 
that these sub-goals are equal in priority. For 
example, under the risk goal, milestone risk and 
technological risk are assumed to be the same in 
importance. The AHP has the capability of handling a 
Situation in which this assumption was not true, but 
there is not sufficient information concerning the sub- 
goals to conclude or assume differently. 

Another key assumption is that the program element 
managers are the best individuals to respond to the AHP 
Survey. Much has already been said about the vast 
espertise that they possess, and it was the 
overwhelming consensus of the chain of command at the 
USASDC that program element managers were best suited 
to make the subjective judgments upon which the AHP 
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model, and the subsequent GP model wits ba ad If thats 
assumption was not true, than the model developed 
this chapter would not be valid. 

The final major assumption to be discussed is that 
the total funding level for the major USASDC projects 
in FY 88 is not known, and that the four funda 
Stlatver tes (core, basic, enhanced, and extended) are 
the only) alternaciyvese The model could be Gace 
changed to handle any funding strategy, but it will be 
assumed that only the four strategies mentioned in the 
USASDC Budget Priorities Briefing [Ref. 3] are of 
COncernh:. This assumption is most important ag 
simplifying the data analysis of Chapter VI. 
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VI. SOFTWARE SUPPORT AND MODEL RESULTS 


As stated in Chapter II, the primary objective of 
this study is to develop a research and development 
project funding model of the major USASDC projects, and 
to use this model to determine optimum expenditure 
levels for each project in FY 88. such a model has now 
been completely developed, and this chapter is intended 
to present both the computer programs written to solve 
the model and the model results. Spec scadaby, thas 
entails a discussion of the data collection and 
software development process, the numerical output 
acquired from the various model iterations, and the 


consequences of the data produced. 


A. DATA COLLECTION AND SOFTWARE DEVELOPMENT 

The process of collecting data and designing 
software to support the GP model formulation is an 
essential step in determining the optimum expenditure 
imevels for each major project in FY 8&. As discussed 
earlier, the GP model requires that the coefficient 
weights for the goal and system constraints be 
determined by the AHP, in addition to the achievement 
function weights. Program element managers were 
selected to respond to a pairwise comparison survey 
that was designed to subjectively evaluate the major 
projects being studied on the basis of the eleven key 
factors discussed earlier. A detailed description of 
this data collection effort anda copy of the actual 
surveys that were written can be found in Appendix C. 

Computer software was written that would perform 
the necessary AHP calculations and determine the 
coefficient weights for the GP model. APL [Ref. 38] 


was the computer language chosen to perform the AHP 
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calculations, since APL is particularly powerfully 
performing array computations. An APL workspace called 
"AHP", consisting of nine APL functions, was) writ tcume 
an IBM PC using "APL Plus 5.0", an APL program compagiiee 
produced by STSC. The workspace was intended to be 
easy to use and have a broad range of applicabi iia 
All programs were generalized, so that the AHP cana 
used on any subjective data array, not just the Usage 
data set presented here. The programs were also 
designed to be interactive, so that a user is prompeee 
for the information needed as the program progressesyaa 
fear e | than helps avoids coniuctrone Appendix D 
contains the complete program listings of all nines 
functions, as well as detailed information on Howes 
use "Lhe workspace. 

The Generalized Algebraic Modelling System (GAMS) 
[Ref. 41] was selected to solve the GP model. GAMS is 
significant because it is the first optimizing propa 
that uses the special notation called the Backus-Nauer 
Form (BNF). This notation enables the user’ to write 
constraint equations in precise mathematical forme 
greatly enhancing the flexibility and simplicity ote 
program code, A GAMS program was written for each of 
the four possible funding strategies based on the GP 
model of the major projects of the USASDC. Appendix E 
contains the complete listing of the GAMS program for 
the core funding strategy, and it also includes aymeg. 


detailed discussion of how the program was constructed. 


Bo, MODES Resucis 

The output from the AHP procedure and the GP model 
will be surveyed in this section. This evaluation will 
include an analysis of the optimal funding levels for 
each major project and the optimal funding priorities 


at each budget strategy (core, basic, enhanced, 
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extended ). Tico tLiinals 1undine Levels and priority 
lists obtained by the model will be compared with those 
that have been proposed for FY 88. 
aleve AHP RESULTS 

The AHP surveys were collected and the 
pairwise comparison data from these surveys was entered 
into the APL "AHP" workspace. A complete iteration of 
mae AHP “program involves 55 matrices, derived from 
comparisons of projects within each program element. 
As stated in the second chapter, these comparisons are 
based on eleven components. Each component contributes 
moereither the payoff, risk, time, or balance factor. 


The initial run of the AHP program was not successful, 


Since several of the 55 compared matrices were 
determined to be inconsistent, ie, the consistency 
ratio for these matrices was above 104. Respondents 
liable for the survey completion were contacted, 


informed of the problem, and asked to make corrections 
in their responses that would reduce the CR for each 
inconsistent matrix to an acceptable level. The second 
meeration of the AHP was successful in resolving this 


issue, as is demonstrated in Table 17 below. 


TABLE 17 
AHP CONSISTENCY RATIO RESULTS 


FACTOR 
PAYOFF RESK TIME BALANCE TOTAL 
# MTXS ES 10 10 20 By) 
AN .048 047 ~045 004 03H 
STD DEV .029 028 S033 007 O31 
RANGE 097 082 .089 O21 .097 
| 
Each of the factors had an average CR value 
well under 10%, and not one of the 55 matrices was 
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to the GP 
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be inconsistent. 
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violated, 


be 


Standard for consistency nee 
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Since inconsistency will adversely affecvuwaa. 
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accuracy and credibility of the model 


TABLE 18 
AHP COEFFICIENT WErGH hs 
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A more complete collectl oma 


Table 18. 
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PaewOuUtDIeeiroMme the —~AHP »workspace can be found in 
Appendix F. The payoff factor eigenvector and the 15 
Matrices that contr touted ~ to Peomecatculation» is 
included in this appendix. 

The determination of the four factor weights in 
the achievement function was also found via _ the AHP 
workspace. These weights are extremely important, as 
eeverepresent the relative priorities of the payoff, 
risk, time, and balance goal constraints in the GP 
model. The comparison matrix, consistency information, 
and weight GrIgemvectors regarding theweachievement 
munection is shown in Table 19. 


TABLE 19 
ACHIEVEMENT FUNCTION AHP RESULTS 


Comparison Matrix 


Payoff Risk Pane Balance 
Payoff 4 2. 5 a 
Risk ee, 4 3 5 
Time 1/5 1/3 } 2 
Balance ie 7 es in 2 i 

Lambda: 4.020 

Consistency Index: .007 

GConsistency Ratio: @ 007 

Payoff weight: moc / 

Risk weight: oo) 

Time weight: 2 10 

Balance weight: 063 

ee GP Results - Optimal Funding Levels 


The coefficient weights OF the goal 
constraints and the achievement function determined 
above were incorporated in the GAMS program. The 
optimal funding levels for each project are displayed 
in Table 20. 
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TABLE 20 
OPTIMAL PROJECT FUNDING LEVELS ($M) 


Funding Strategy 
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Table 20 shows AHP results from each model 
1teration: The only change between runs was”) that the 
budget level system constraint RHS was increased for 
each successive repetition. For example, the core 
iteration used a budget figure of $882.6 million; this 
was altered to $1029.1 million for the basic lrg 
Appendix G contains the solution summary and several 
additional reports from each of the four budget 
Strategy model repetitions. 
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mestlonificant s@ekbservation is that almost all 
projects, regardless of the funding strategy, are 
funded at a level equal to either the minimum or 
maximum bound of that project. The GP optimizer 
selects projects that contribute the most to the 
achievement function for funding above the minimum 
level . Once an "efficient" project such as this is 
identified, the optimizer adds to the decision variable 
mrerl the project reaches its upper bound, or the 
budget is exhausted. 

Only projects that provide the most payoff 
and/or balance while costing little in risk and/or time 
are deemed efficient, and these projects can be 
identified by observing the marginal values. The 
marginal values for the individual projects at each 
model run (see Appendix G) indicate the rate at which 
the objective function value improves as _ the RHS 
increases a small amount. Since the GP model attempts 
to minimize the deviation variable in the achievement 
function, only the projects with a negative marginal 
value are funded above the minimum bound. 


The budget increases 56.7% from the core to 


the extended strategy, so it was expected that many 
projects would demonstrate a dramatic increase in 
mounding. Mie number Or projects funded at the minimum 


~~ 


level in the core strategy was 28, a ~figure that 
dropped to 14 at the extended budget strategy level. 


The optimization program does not increment each 
program a small amount when given additional budget 
money. Rather, it finds additional projects that 


enhance the achievement function and then uses these 
projects to the fullest extent possible. 

AMOtReER critical aspect ~of the GP model 
results concerns the difference between the optimal 
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funding levels, as determined by the model, ~andgeare 
proposed funding levels. The FY 88 proposed levels 
were discussed in Chapter II and can be § £f£ouncia 
enever aelilse Ie) The optimal and the proposed funding 
levels for each of the four budget stratesiec@ae 
plotted against each other in Figures 5 throueheauae 
the following pages. The funding levels f£6P aie. 
various projects are on the y-axis and the projeem 
(represented in order and numbered 1 through 35) are 
displayed on the x-axis. In viewing these graphs, tie 
optimal and proposed funding levels appear closely 
re latea: The y-axis scale accentuates the difference 
between the two levels, but one cannot be certain ia 
this difference is substantial. <A statistical teste 
needed to make this important determination. 

The nonparametric Kolmogorov-Smirnov  two- 
sample goodness of fit (K-S) test was used to decide if 
the proposed and optimal distribution functions are 
iden tac aula The K-S test calculates the maximum 
distance between the cumulative distribution Tuncutem 
of the two samples. If the deviation is large enough, 
the null hypothesis that the distributions are the are 
is rejected. A deviation figure, DN, is calculated aa 
compared against the critical deviation figure founda 
a K-S test table, a number based on the sample size and 
Sionit pPeanecem level. The PC statistical graphics 
program "Statgraphics", published by STSC [Ref. 44], 
was used to determined DN and an associated P-value. 
Small DN and large P-values support the null hypothesis 
that the two distributions are the same. With a .05 
level of significance, the null hypothesis cannovuspe 
rejected if the P-value is greater than .05 [Ref. 43]. 

The K-S procedure is generally more efficient 
that the Chi-square test for goodness of fit, and is 
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Figure 6 - Basic Budget Strategy 
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Figure 7 - Enhanced Budget Strategy 
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Figure 8 - Extended Budget ssenar, 
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Piivesencltivesto population differences with respect 
to location, dispersion, or skewness. The K-S test was 
performed on the optimal and proposed funding levels 
hor each budget strategy, and the results are 


Summarized below in Table 21. 


TABLE 21 
OPTIMAL AND PROPOSED FUNDING LEVELS 


Kolmogorov-Smirnov Two Sample Test Results 


SpE ee gy DN SEO level 
Core 3142 .0630 
Basic or 4 -0160 
Enhanced St 7 -1148 
Extended -2000 ~-4858 
A review of these results leads to the 


deduction that the optimal and proposed funding levels 
meemvery Similar. The null hypothesis can be rejected 
at only the basic funding strategy, and the association 
between the two is particular strong at the enhanced 
and extended ihe wewlse, These results support the 
intuitive inference of Figures 5-8; they show 
satisfactory correlation between the two distributions, 
marercularly at the upper spending stages. However, it 
jms clear that several projects at each strategy level 
Seoibit substantial differences that demand attention. 
Polke sultsce— Optimal Priority List 
ihewmarcinal values from the GP model output 
that were mentioned above provide information that 
makes possible a determination of project priority at 
een budget strategy. Appendix B contains the priority 
list of projects presently used by the USASDC. A 
comparison of the present USASDC priority list with the 


aS 


optimal one derived from the GP model would provide 
additional insight. 

The marginal values indicate the order in 
Which the projects are selected for funding above the 
minimum bound. Projects that have the smallest 
marginal values are those that are valued by the 
optimizer the most. For example, a project with a 
marginal value of -.025 was given additional fundeuiy 
the optimizing program prior t0 aA project (wie 
marginal value of -.005. 


TABEE 22 
OPTIMAL PRIORITY List OF MAJ@GRUTRCUECis 


Number Project Marg Number Project Marg 
il K222 -.0313 19 Liz -.0034 
Z D044 -.0294 20 LaZz3 -.0037 
S DO76 -.0285 Zale 5102 -.0038 
4 5243 -.0242 2a 5402 -.0010 
5 Bi42 = Uo ao 5052 -.0013 
6 BO32 -.0221 24 S281 -.0002 
f KoZi -.0204 25 K624 -1.6E-3 
8 S27 -.0178 26 DO8O -1.3E 8 
9 S091 -.0150 Ze D412 -0.4E-3 
10 D047 -.0141 28 S051 .0023 
Lia 5053 -.0120 29 Bulze -0061 
2 D083 -.0129 30 Bows .0090 
ae K325 -.0082 oat K524 0172 
14 K225 -.0083 S32 Di l2 0236 
15 K3823 -.0083 30 Koi . 0285 
16 [Zale 2 -.0064 34 D114 .0264 
le? L503 -.0051 35 S011 0297 
18 LOO8 -.0057 


The priority list shown in Table 22502 
determined by simply rank ordering the various project 
marginal marginal values. A noteworthy observation is 
that the priority list does not change for any of the 
budget strategy model iterations, or any other budget 
level selected. The marginal values change, DU eae 
rank ordering does not, so the optimal pricrity listie. 
preferred projects can be determined at any budget 
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level in the feasible region of the model solution. 
Table 22 displays the priority list and marginal values 
derived at a budget level of $1615.1 million. 

The $1615.1 million funding level is 
-Penit icant ~because at this level the achievement 
function reaches its lowest value. At funding levels 
greater than $1615.1 million the objective value does 
not decrease, despite the infusion of additional funds 
myco the model. This demonstrates that the bottom 
eight projects on the priority list of Table 22 will 
not contribute to the achievement function at any 
budget level, since the marginal values are always 
positive. The $1615.1 million funding level identifies 
those projects that do not contribute to the goals of 
the USASDC, no matter how much research and development 
money is available. In these unfortunate instances the 
payoff and/or balance benefits are exceeded by the risk 
and/or time drawbacks) and money spent on then, 
according to the model, is wasted. 

Similarly, the top seven projects are 
me@entified by the priority list. These are all 
projects that have highly favorable marginal values, 
ie, less than -.20. It should also be noted that each 
me these projects is optimally funded ate thet fr 
respective maximum levels at even the lowest budget 
Mmvels. These top seven projects contribute the most 
mor Minimizing the goal constraint equations) and 
optimizing the achievement function. 

A comparison between the proposed and the 
optimal priority lists was made graphically in Figure 
9. The plot of the difference vector makes it obvious 
mae there is little similarity between the two 
priority lists. This supposition was verified by using 


Kendall’s test for rank correlation, a nonparametric 
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procecauren1 OF Getermining a correlation coefficient, 
fviebea Kendal’ s ) lau, based Yon rank. A Kendall’s Tau 
coefficient close to 1.0 demonstrates a high degree of 
pereement between the two vectors. In this case, the 
tau statistic was computed using Statgraphics and found 
to be .1193. This low correlation coefficient supports 
mie hypothesis that the two priority lists are 
Senitficantly different. 
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VII. SENSITIVITY ANALYSIS 


In previous chapters, a model was developed based 
on several key elements of data that were obtained ram 
surveys regarding the major projects preséntly Bema 
funded by the USASDC. It is obvious, however, that 


responses to these surveys may not be perfect; the data 


used may pe subject to =) O) GO) Ox, and resource 
availabilities and subjective evaluations can Change 
with time. It is the purpose of this chapter to 


analyze the impact of changes in the goal programming 
model. specifically, this entails determining age 
sensitivity of the model to changes of the followiiee 
(1) -total USASDC. “budget (2) minimum and maximum 


project funding levels; (3) goal constraint 
coefficients; and (4) achievement functiem 
coefficients. 


A. CHANGES IN TOTAL USASDC BUDGET 

The model was designed to handle changes in tie 
total USASDC budget with ease, and five different 
budget levels iterations were discussed in the lage 
chapter. The possible budget levels that can be Tua 
the model are infinitely many, as long as the budget 
figure is within the bounds established by summing tie 
various project minimum and maximum funding levels, 
$348 million and $1788.9 million respectively. 
However, possible as it is to run model iterations with 
a budget figure of $1788.9 million, it really ise 
practical to exceed $1615.1 million. This was the 
budget level identified in the Chapter VI as’ the point 
where the achievement function is minimized; budget 


levels above this do not enhance model performance. 
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Picwetocalensumdeet “will yield different funding 


Mevelec for Cach project. However, the optimal priority 
list, as discussed in Chapter VI, does not fluctuate 
with budget variations. This fact enables the use of 


mae optimal priority list as a predictive tool that 
greatly enhances the validity of the model. For 
Swamnole, consider budget variations in the vicinity of 
the core strategy level, $882.9 million. At this level 
mie first seven projects on the priority list were 
mounded at the maximum level and the eighth project, 
5271, was optimized at a level higher than its minimun, 
but less than its maximun. If additional R&D funds are 
somehow made available, the priority list indicates 
that the model will initially spend this money on 8271 
until it reaches its maximum level. If still more 
funds are accessible, the model will allocate the money 
fromthe ninth project on the priority list. Likewise, 
if the budget is reduced from the basic strategy, the 
model will reduce the funds devoted to S271 before it 
takes money away from the number seven project. By 
increasing the flexibility and applicability of the 
model regarding changes in the total USASDC budget, the 
determination of a priority list in Chapter VI can now 
be seen as an important contribution to the sensitivity 
or the model. 


B. CHANGES IN MINIMUM AND MAXIMUM PROJECT BOUNDS 

Program element managers provided estimates for the 
minimum and maximum funding levels for each project, as 
mieseussed in Chapter IV, and it is possible that some 
of these approximations may change. Deviations in the 
upper and/or lower bounds can have a profound bearing 
omethe optimal funding levels computed by the GP model, 
Pee once again the optimal priority list can be used to 
help predict the impact. 
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The minimum funding levels must first be satisfied 
before the model begins allocating money to other 
projects. Consider a project that, at a piven budeen 
level, is being funded at its maximum level. A change 
in the minimum funding level of this project will 'iiawe 
absolutely no effect on the model results. Likewise, a 
change in the upper bound of a project being Tuma 
below that level will not alter model output. However 
any other situation will vary the model results. If a 
project funded at the minimum has its lower boeuae 
reduced, then the additional money will be directed to 
the next available project on the optimal priority Vist 
that has not yet been maximized. The same result will 
occur if a | project Miundedwea. its maximum level 
experiences a reduction in this upper bound. 

In a similar manner the GP model will take money 
away from projects according to the priority. 
This will occur if projects not being maximized ia 
their lower bounds’) increased, or maximized projects 
have their upper bounds’ increased. Of course, the 
number of projects that will be affected by the changes 
in the bounds depends on the number and size of these 
modifications. Nonetheless, the impact of even large 
changes can be anticipated by using the optimal 
priority list, a feature that ensures that the GP medea 
is sufficiently responsive to changes in the minimum 


and maximum funding levels of individual projects. 


C. CHANGES IN GOAL CONSTRAINT COEFFICIENTS 

Survey results were converted, using the AHP, into 
135 goal constraint, coeiiicientce The surveys were 
based on subjective judgments that can possibly vary 
for a number of reasons. In this section an analysis 
of the impact of changes in the subjective evaluations 
will be conducted. 
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View ttcotecttlation Lo Aanvestigate is the impact of 
a mistake in completing a survey or transcribing data 
from a survey. One of the advantages in using the AHP 
procedure to generate weights from subjective 
evaluations is that it has a built-in mechanism to 
detect errors of this iy pe. This feature is 
mebustrated “in JTable 23, a table that displays an 
actual matrix taken from the AHP output in Appendix F 


and a "flawed" matrix that contains an input error. 


TABLE 23 
COMPARISON OF ACCURATE MATRIX WITH FLAWED MATRIX 


Accurate Matrix Flawed Matrix 
iL i: 2 5 1 i. 2 i 
il J 2 i 5 J J 2 1 5 
ie, 2 172 iL 1 5 eee LZ 1. 1 5 
/5 175 175 7 i 1/5 1/5 1/5 3 
1/5 1/5 Hey 5 1/5 1 1 1/5 es fe 1 
CONSISTENCY RATIO: .017 CONSISTENCY RATIO: 2.117 


The only change that was made in the flawed matrix 
is that the upper right-hand number was changed from 5 
mo 1, representative of a common typographical error. 
The consistency ratio (CR) computation turns this 
Simple mistake into a glaring error by raising the CR 
to above 10%. Since a CR this high is unacceptable, 
the matrix data input would have to be examined and the 
Smmor corrected. This example demonstrates’7 the 
sensitivity of the GP model in responding to minor 
lapses, a feature that makes the model results more 
eredible. 

The GP model might also be subjected to a change of 
opinion. <A respondent to a survey could decide that a 
project was judged inappropriately. Once again it is 
illuminating to look at an example of such a situation. 
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Consider it ie comparison matrix of KEW projec 
according to milestone risk shown in Table 24. 


TABLE 24 
KEW/MILESTONE RISK - ORIGINAL COMPARISON MATRIX 


K222 K623 K624 K225 K323 K325 Koa 


Kea 1 1/5 1 1 1 1 175 i 
Koad 9 1 5 5 5 9 il 9 
K624 1 AS 4 a c a 4 2 
K22. 1 3 ae it 1 1 ls il 
Kegs il 1G 12 1 1 it 1/5 1 
Koa2o 1 1/5 152 i 1 il 1/9 al 
K524 9 1 ) 9 9 9 } 3 
ce Aall iL 1S Ney) ee it i il ae 1 


Consistency Ratio. 04a 
Eigenvector: .062 .308 .116 .055 .055 .051 2302 333 


Suppose the KEW program element manager receives 
information implying that he overestimated the 
milestone risk of K623. The program element manager 
might then change the original comparison matrix to one 
as shown in Table 25. 


TABLE 25 
KEW COMPARISON MATRIX WITH MINOR CHANGES 


K222 K623 K624 K225 K323 K325 Ko24 5h22R 


Kec. al Ae i il 1 it 1/2 il 
K623 Z 4 2 2 a Zz il a 
K624 i ee 4 a a Z 4 eG 
K229 1 2 1/2 il 1 it 1/5 a 
K323 ik ey ee a 1 iL 5 1 
KgZo il Ly eZ 1 1 1 1/9 1 
K524 5 5 9 9 V 9 
Koa il 1/2 Wf il i il ao 1 


Consistency Ratio: 2042 
Eigenvector: .089 .178 .140 .069 .069 .066 .321 .066 
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Tre only numbers#ehanged in the this new matrix are 
those in the second row and second column, values 
Sorresponding to project K623. The numbers’ in the 
Deis inal mathmix were larger, Signifying that K624 
involves a high degree of milestone risk. The lower 
numbers in the new matrix denote that the milestone 
risk for K623 is not as substantial as the first matrix 
wraimed . ims is alserretPected by the coefficient 
eigenvector. ticmlarSeohmec@oculTecTenun Change Occurred 
in the K623 value, which dropped from .308 to .178, but 
bite Other project coefficient weights increased only 
slightly. A K-S test was performed comparing the two 
different elgenvectors. The computed P-value was .27, 
mera eh 6h Value Signifying that the minor changes in the 
Somparison matrix did not significantly alter the 
matrix output. 


TABLE 26 
KEW COMPARISON MATRIX WITH MAJOR CHANGES 


KZigeeOes KO24 K225" K323 K325 K524 K321 


eae C au oy es J J J J ees i: 
K623 5 1 1/5 1/5 179 ao a 1/5 
K6o24 a 5 2 2 Z 4 2 
K225 1 5 ee 1 1 1 1/5 1 
K323 1 5 i) 2 a a 1 PS il 
K325 1 D Ae il il 1 1/9 1 
K524 5 9 5 5 9 9 
K321 1 D Ly 2 1 i 1 79 at 


Consistency Ratio: .031 
Besenvector: .091 .022 .167 .081 .081 .077 .406 .077 


To continue with the KEW example, Table 26 displays 
mae results of a major change in the program element 
manager’s opinion of K623. Now the Knowledge available 
is such that the manager feels K624 has the least 
amount of milestone risk of any of the KEW projects. 
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The second column and second row feature very small 
numbers, changes that have “abe effect on ize 
eigenvector of coefficient weenie Not only has the 
K623 coefficient has decreased considerably from .308 
to .Q22, but the other coefficients have all incresaaen 


approximately 504. The K-S test statistic when this 
latest eigenvector is compared with the original one is 
Tso, Indicative, tna ne two eigenvectors are 


Considerably “ditt erence. 

The example above demonstrates the sensitivity of 
the model to major subjective changes in the respomec. 
to the AHP surveys. Despite the fact that the KEW 
milestone risk eigenvector has been altered bye 
changes, it remains to be determined if this will ia 
an impact on the overall risk eTpenvVectcorm-: As 
discussed in Chapters II and IV, each of the four majee 
factors (payoff, risk, time, and balance) are comprised 
of several sub-factors. In the case of risk, the sub- 
factors are technological risk and mitectonew ie 


The complete AHP program was run with the modified 


matrix and anew risk eigenvector was computed. This 
eigenvector was compared with the original by means of 
the K-S test. The K-S P-value was computed as .4858, 


so it is evident that much of the deviation thathiag 
been stimulated by the major changes in the KEW 
milestone risk matrix has been suppressed at this 
higher level in une model. 

The new risk eigenvector was substituted into the 
GP model. The GAMS model was run at the core strategy 
level and the results proved netabtec. Only two 
projects were affected by the new eigenvector, so the 
calculated P-value of .9830 comparing the new with the 
original optimal funding levels was not surprising. 
However, the fact that the funding level for K623 was 
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not altered by the changes was surprising. The model 
naokx plow miligkon from B1l42 and gave it to K321. The 
new optimal priority list was computed, and it shows a 
drop of several places in rank order of B142. K321 
GBetains its place on the list and since it is the next 
project that is not funded to its maximum level, the 
funds taken from B142 are given to K321. 

Pienorscusslonmwabeve Should point out the inability 
of the model to predict the impact of major changes in 
subjective evaluations. What began as a change in the 
opinion of a program element manager regarding project 
K623 ended up affecting the funding levels of two other 
Bro, ects. fis  reswlt demonstrates the complex 
interrelationships of the goal coefficients and the 
difficulty in anticipating the repercussions of major 
Opinion alterations. The model responds very well to 
simple errors and minor CHanctes sin OlVving tne 
subjective evaluations, but major changes unfortunately 
demand a complete reiteration of the model. 


D. CHANGES IN ACHIEVEMENT FUNCTION COEFFICIENTS 

The most important comparison matrix used in the 
model is the one that determines the achievement 
function coefficient weights, and a matrix that was 
displayed and discussed at length in the last chapter. 
This section is concerned with the impact of changes to 
mmemachievement function coefficients. 

ihe original weignts for the achievement function 
were based on the perception that maximizing payoff was 
the most important goal of the GP program, and 
minimizing risk was a close second priority. 
Minimizing time was important, but not as critical as 
the goals involving payoff and risk. Maximizing 
balance was considered the least important objective in 
the achievement function, but a goal nonetheless. In 
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mathematical notations this situavrom can be 


represented as shown below in equation 7-1. 
Original Ach Fn: Payoff > Risk > Time > Balance (7a) 


It is recognized that the original goal priorities 


used in the model might change someday, simwec 
organizational priorities often change. Keepins” swe 
possibility in mind, the following four achievement 


function situations were envisioned: 


Situation 1: Payoff = Risk > Time > Balance (7-2) 
Situation 2: Risk > Payoff > Time > Balance (7-3) 
Situation 3: Time >» Payoff >» Risk > Balance (7-4 ) 
Situation 4: Payoff = Risk = Time = Balance (7-5) 


There are many possible priority relationships, .pue 
these were selected as likely scenarios that Ween 
satisfactorily demonstrate the impact of achievement 
function changes on the model results. The feu 
situations were converted into AHP comparison matrices 
according to the procedure discussed in Chapters IV vane 
VI, and the complete results of these AHP iteration can 
be tound in Appeéenatx a. The weight eigenvalues 
obtained from aie AHP workspace depicting each 


achievement function situation are shown in Table 27. 


TABLE 27 
ACHIEVEMENT FUNCTION EIGENVALUES —- SITUATIONS Sis 


Situation Payoff Risk Time Balance 
Original Oia .301 ae .063 
- 425 42 093 -056 
2. Sail ~542 079 .048 
2 250 woe Dome 041 
4 250 neo 0 250 ~ ool) 
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The achievement function coefficients from Table 27 
were each programmed into the GAMS GP model in the same 
mavetiace tne original weights were. The four different 
situations were run on the GP model at each funding 
strategy budget level. The output from this endeavor 
is contained in Appendix I. Listed in Table 28 are the 
results of numerous tests comparing the funding vectors 
and optimal priority lists derived from the original 
and supplemental model iterations. 


TABLE 28 
GP RESULTS - SITUATIONS 1-4 COMPARED W/ ORIGINAL 


Core Budget 
K-S Deviation: -0000 
P-value: 1.0000 


Basic Budget 
K-S Deviation: -0000 ee 
P-value: 1.0000 me 
Enhanced Budget 
K-S Deviation: -00 
P-value: 1.00 
Extended Budget 
K-S Deviation: -16 
P-value: -56 


eriorit List 
Kendall’s Tau: -6336 ~5462 -.0017 -2939 


The data contained in Table 28 demonstrates the 
extremely wide range of validity that the GP model 


possesses. Situation 1 involves slight changes in the 
Seerticient weights, and the optimal funding levels 
meiectead at the three lowest budget levels are 


identical with those of the original model. The P- 
Mamue at the extended level indicates that there is 
only slight deviation from the original extended 
funding levels, and the optimal priority i lkist 
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correlation is sh ten- In Situation 2, risk has been 
established as a higher priority than payoff, butweme. 
at the extended funding level do the model results from 
this iteration differ significantly from the origi 
model output. The Kendell Tau figure is still quiere 
high and is testimony to the similarity between the 
original and Situation 2’s optimal priority "ieee 
Situation 4 represents a substantial departure fromm@aae 
goal priorities established for the original model, yet 
the Table 28 data shows that only at the extended 
budget level can one reject the hypothesis that them 
funding levels are the same. However, the Situation 4 
optimal priority list does differ notably frome. 
Orloinai, Situation 3 involves a radical dipreéessien 
from the original in that the payoff coefficient has 
been Pdecreased ® terme aa from 9 2G and the time 
coefficient raised from .11 to .557. Nevertheless, the 
funding levels at the core and basic budget stratecie. 
are not statistically different, further confirmavieen 
of the excellent flexibility and applicability of ee 
GP model that has been developed. 
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VIII. CONCLUSIONS AND RECOMMENDATIONS 


This final chapter is intended to briefly discuss 
the conclusions that can be drawn from the results and 
analysis of the GP model, as well as state the 


recommendations that this study has motivated. 


A. CONCLUSIONS 
Hie. presen. roposed project funding levels are 

Vall tds node l huUnding levels are optimal. 

The proposed funding levels for the 35 major 
USASDC projects do not vary significantly from the 
optimal levels determined by the model for three of the 
budget strategy levels. However, there is substantial 
variation from optimality at the basic strategy budget 
level. The similarity between the optimal and proposed 
levels are acceptable for the core and enhanced 
strategy, but their respective significance levels are 
low enough to cause some concern. The best course of 
action is to make the minor funding corrections needed 
to convert the proposed levels to the optimal ones 
Suggested by the model. 


he iiemonecenumprlonity list in use is not valid; 

Eien nodel priority list@is optimal. 
ilemproneet  Drtori ty list presently in use by 
the USASDC differs significantly from the optimal 
mraority list. An accurate priority list has been 
femenstrated in Chapter VII as an excellent predictive 


device, enabling managers to speculate appropriate 
responses to changes in budget level and individual 
project bounds. item ODptINat a provect priority list 


calculated from the model should replace the present 
Mmamoricy list so that an accurate and effective tool is 


at the disposal of key management personnel. 
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oo The bottom eight projects on the priority ieee 
are not productive. 
In Chapter VI it was discovered that the last 
eight projects on the optimal project priority 112 
non-negative marginal values at every funding level in 


the feasible beo rons This indicates that these 
projects do not make any positive contributions to the 
model goals. In these unfavorable instances’ the 


advantages afforded by spending money on the projects 
are exceeded by the disadvantages they accrue gues 
funding for these projects should be terminated as soon 
as possible. If these projects are reduced from their 
present level of funding to their respective minimum 


funding levels, a savings of $63.1 million dollarcuaaae 
be realized: 
4. The top seven projects on the priority saw 
are paneicular ! roductive. 

The top seven projects in the priority 
demonstrated highly productive characteristics, as@va. 
explained in Chapter VI. At the $1615.1 miiieen 
funding level, each of these projects had a marginal 
value under -.20, and each project was optimized at its 
respective maximum funding level for every model 
iteration. Funding priority should be given tothe 
very favorable projects. 


By ¢ A total USASDC budget for the major ™projcen 


of over $1615.1 million is not lproduc tive 
The $1615.1 million funding level for the 35 


major projects was determined as the point where the 
achievement function was minimized. Money spent in 
excess of this amount does not decrease the objective 
value any further, since these additional funds can 
only be spent on the ten unproductive project] 
$1615.1 million “all Vproijecrs that make favorable 
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EOuuribUElons to “the ~model are at their respective 
maximum funding levels. Total budget endowments 
greater than $1615.1 million should be diverted to 


more productive research and development endeavors. 


6. The GP model developed is flexible and has a 
wide range of validity. 
The GP model developed has been successful in 


meeting all the objectives of this study. The AHP has 
fPeen, used Sto convert previously vague subjective 
evaluations into the precise mathematical coefficients 
meeded for a reliable solution. The GP model has been 
analyzed as very adaptable to changes in the model 
parameters and the R&D environment. Simple and 
versatile personal computer software has been written 
to support all computational aspects of the model. A 
user with a properly organized data base can perform a 
completely new iteration of the model in less’ than an 
hour. These characteristics help describe a model 
worthy of wide dissemination and use. 


loa RECOMMENDATIONS 

1. R&D funds in FY 88 should be provided to each 
major project as shown in Table 20 of Chapter VI 
according to the budget strategy that is approved 
for the USASDC. 

<2. The optimal project priority list displayed in 
Table 22 of Chapter VI should immediately replace 
the present priority list used at the USASDC. 

3. Steps should be taken save $63.1 million by 
eliminating the following eight projects as soon 
as possible (listed in order of elimination 
priority): 

a. S011 - Cobra Judy 
b. D114 - DEW Concept Development Defn 
Cz K623 - Invite, Show, and Test Forum 


ot 


D1il2 - Interactive Discrinmaeeon 

K524 - SDI Targets 

B612 - National Test Bed 

B122 - Theater Missile Det Arenitvecitia— 
h. $051 - Optical Airborne Measurement Pgm 


0@ *» 2 


4. Steps should to taken to ensure thewiolle. aie 
seven projects receive maximum priority and 
Funding Support: 

a. K222 - Exoatmospheric Interceptor. a5 

D044 - AFOCAL Technology 

DO76 - Free Electron Laser Demonstrattenm 

S243 - LWIR Probe 

B142 - Architecture Support Analysis 

B532 - Battle Mgmt/C3 Experimental Sys 

g@. K321 - Endoatmospheric Intérceptorsr wee 

5. Total funding for the major USASDC projects should 

not be allowed to exceed $1615.1 million. Excéss 


ity) ee Ones 


funds should be diverted to more promising Reap 
Ei iOrus. 

6. The GP model developed in this paper, and the 
associated software designed to support it, should 
be implemented as soon as possible as a management 
and planning tool in the USASDC Program Analysis 
and Evaluation Directorate. 
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APPENDIX A 
PROGRAM ELEMENT DESCRIPTIONS 


USASDC technical efforts are structured into five 
Program clements, each element examining important SDI 
technology. Program element managers are assigned to 
each program element, and they monitor and coordinate 
the funding and conduct of the research efforts in each 
area. Many of these projects in the program elements 
have already been responsible for some outstanding 
experimental results. A discussion of the focus of 


each of these program elements follows. 


A. SURVEILLANCE, ACQUISITION, TRACKING AND KILL 

ASSESSMENT (SATKA) PROGRAM 

The SATKA program provides sensor research efforts 
involved in performing surveillance, acquisition, 
tracking, discrimination and kill assessment of hostile 
ballistic missiles. The SATKA program is critical to 
the overall success of the SDI, since a target must be 
identified and tracked before it can be destroyed. 
There are three basic sensor types involved in the 


accomplishment of this important mission: 


1. Rocket launch detection sensors - used to detect 
the the initiation of an attack. 
2. Midcourse sensors - employed to track 


atmospheric reentry vehicles and decoys in 
midcourse. 

3. Terminal phase sensors - utilized to track 
attacking warheads in the last seconds prior to 
impact. 

Key components of the SATKA program are technology 
development experiments and data collection efforts. 
This program element has the largest number of R&D 
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projects being managed by the USASDC and accounts ie 
over 35% of the Fiscal Year 1987 budget. Research 
efforts are being concentrated in the following area 
Ie a Clate ce Laser ar adage, infra-red sensors, interactive 


discrimination, and sipnal proceseiin-- 


BY. DIRECTED ENERGY WEAPONS (DEW) PROGRAM 

The DEW program identifies and validates the 
technology supporting directed energy systems; Je 
hoped that these systems will be able to discrimimiawee 
decoys from warheads, and then destroy large numbers of 
enemy vehicles in split isecenuse This discrimination 
and intercept mission is key to achieving high levewgs 
of ballistic missile defense effectiveness. 

To achieve the DEW goal, research has been 
directed towards technologies that perform the 
functions of (1) generating a high energy destruction 
beam; (2) conditioning the beam and delivering it for 
propagation toward the target; (3) focusing the beam at 
the target along a prescribed path; and (4) hitting the 
target and reinitiating the sequence quickly  1n onan 
to engage a new target. Thus, the DEW program ince. 
work on laser devices at various wavelengths; laser 
beam control . and Vopeics : particle beam technoloseve 
pointing and fire control; and nuclear directed enereag 
weapons. 

The DEW program has funded R&D in two major new 
technologies, the Ground Based Free Electron Lases 
(GBL) and the Neutral Particle Beam (NPB). Several DEW 
projects involve GBL and NPB proof-of-feasibility and 
data collection experiments. 


Cx KINETIC ENERGY WEAPONS (KEW) PROGRAM 
R&D efforts in the KEW program support all options 
involved in kinetic energy guided projectiles. As a 
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relatively mature set of technologies, these endeavors 
are expected to provide ie weiner Ce p it and kill 
functions for initially deployed ballistic missile 
defenses. KEW weapons are also very useful in the 
defense of space platforms. 

Kinetic energy projectiles rely on nonnuclear kill 
mechanisms. they are acee le~actecam== by Chemically 
propelled boosters or hypervelocity electromagnets. 
Chemical rockets are in amore advanced technological 
state, but nvyperve Loci ty weapons are considered 
preferable in engagements that involve very large 
numbers of engagements in short periods of time. 
Hypervelocity guns are also attractive because of their 
ability to achieve rapid target kills with minimal 
system weight impact. 

The KEW program is developing technology in four 
major R&D areas. these i netude. (1) space-based 
kinetic kill vehicles; (2) ground-launched 
interceptors; (3) advanced hypervelocity rail guns; and 
(4) fire control support items. 


H. SYSTEM ANALYSIS AND BATTLE MANAGEMENT (SABM) 
PROGRAM 
The SABM program is concerned with the management 
Gee activity on two diverse, but related fronts. 
Systems analysis efforts define the performance 
requirements) of systems that will constitute the 
strategic defense. Battle management research will 


define the operational environment of decisions and 
rules involved in the collective deployment of many 
individual systems. 
specific tasks within the systems analysis 
framework include the following: 
Mmeearchitecture — defining system organization, 
concepts, and parametric trade-offs that allow 


95 


assessment of key technologies and system 
func t homer 

2. Threat analysis - projection of possibWe tire. 
structures and scenarios that will help define 
appropriate US responses. 

3. Logistic integration — addresses leet ma. 
supportability issues across the entire SDI 
program. 

Key elements of battle management research are 
listed abe low: 

1. Situation assessment - concerned with a wide 
variety of algorithms that perform damage 
assessment, defensive firing strategies, and 
network management. 

2. Command, control, and communication - involves 
projects investigating the rapid passing of 
critical battlefield information and directives. 

3. Battle management software - addresses the 
development of some of the most complex computer 
programming ever attempted; software that can make 
instant and appropriate battlefield decisions 


according to programmed instructions. 


|e SURVIVABILITY, LETHALITY AND KEY TECHNOLOGIES 
(SLKT) PROGRAM 
Critical factors in the development of a Strategae 
defense include e1rfectiveneca affordability and 
survivability. The SLKT program performs research an 
the key technologies involving these factoras 
specifically, the SK. program manages research 
Pa tended Lo, 
1. Develop tactics to enhance the survivability of 
defensive components in hostile environments. 
2. Reduce uncertainties that exist in the US 
capability to predict enemy target vulnerabiliags 
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five 


and 


boordimate and Stimulate the development of energy 
generation, conversion, and power conditioning 
subsystems. 

Develop technologies to improve space 
wiranispOrtatlon, repair, and resupply. 

Identify and manage research into the development 
of high technology materials and structures. 
Develop tactical and technical countermeasures in 
order to negate the effectiveness of defensive 
strategies. 

The SLKT program is organized into the following 
projects: (1) System Survivability; (2) Lethality 


Target Bardendns ; (3) Space Power and Power 


Conditioning; (4) Space Transportation and Support; (5) 


Materials and structures Development; and (om) 


Countermeasures. 
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APPENDIX B 
PROPOSED PROJECT FUNDING LEVELS AND PRICGkT 


The funding levels shown in the table below 
represent the presently forecasted funding levelsiign 
each of the 35 major USASDC projects iihie--- The 
major projects are listed in rank order corréspontiae 
to priority. The data for this table was collected 
from the USASDC-Huntsville Resource Management Office 
priority listing, dated 3 Decwerjea. 


PROPOSED FUNDING LEVELS AND PRIORI Dae 
Budget Strategy 


Rank Prroaec Core Basic Enhanced Extended 
1 S2q1 S2.3 95.0 9520 95.0 
2 B142 Grae 6% To, Ta 
3 Kee 1B OF, 0 150.0 i ee) 1 7 Ve 
4 Bac S070 33.20 Olea 5 oa 
5 Ballz 20:20 207.10 24.5 A 
6 K623 24.0 24.0 24.0 24.0 
7 5051 16.4 16.4 16.4 18.9 
8 S011 LO? gO ee, 12m 
9 K624 So) aon) 38.0 38.0 

10 D076 hSss-.0 706 186.5 2 1 lie 
Al D044 5.0 5 aA0 8.0 8.0 
2 S052 Zicine Zea 22 re 2526 
ie ieee 4.8 Beal 5.6 6.0 
14 $053 oe eo 8.8 10.2 
1S $243 9.8 9.8 12 2@ 1326 
16 S402 Loa4 15.4 1 Se4 1542 
IG be23 4.0 Bava 4.8 eee 
18 5091 Sere Lois 18.6 2135 
19 Dita 3.0 La 7.0 Tae 
20 D083 55.0 61.0 61.0 61.0 
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Rank 


21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 


MEOovec. 


D047 
5081 
5102 
K225 
K323 
K325 
K524 
LOO0O8 
B412 
K321 
S281 
B612 
L503 
D114 
L212 


Core 


34.4 


mp oo he = 
on wonidwoworFnawonoeo uo 
J}ouororc§$rcrieoooooo 


-— 
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Enhanced 


Extended 


37.4 

9.0 
16.4 
16.6 
43.0 
18.4 
20.0 
19.8 
12.4 
194.0 
are 
1D od 
10.6 
12.0 

4.5 


APPENDIX C 
AHP MAJOR PROJECT SURVEYS 


The process of collecting data in support of the 
GP model developed in Chapter V is an essential step in 
determining the optimum expenditure levels for each 
major project. This appendix is intended to provide 
information on the AHP surveys that were designed and 
implemented to achieve this end. 

The GP model requires that the following data be 
collected regarding each of the thirty-five major 
projects being modelled: 

1) Military payoff weight factor 

2) Development risk weight factor 

3) Development time weight factor 

4) Development balance weight factor 
5) Minimum funding level 

6) Maximum funding level | 

The data collection effort is complicated by the 
fact that each of the first four items are motivated by 
several subjective evaluations. As discussed in 
Chapter III, the AHP has been determined as’7 the most 
accurate method of converting subjective evaluations 
into the numerical weights required for the model. 

The personnel selected to respond to the AHP 
project survey were the program element managers for 
each of the five program elements: SATKA, DEW, KEW, 
SABM, and  SLKT. These individuals have the most 
project management experience and are assumed to be 
best suited to make reliable pairwise comparisons of 
the projects, as discussed in the last chapter. They 
continually report on and monitor the progress of all 
projects in their respective program elements, giving 
them a sufficiently broad perspective. Program element 
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managers are not likely to be prejudiced towards one 
particular project, as a project manager or research 
scientist might. They also have extensive technical 
backgrounds in their particular fields, giving them the 
expertise to make precise comparative judgments. 

The project survey requested the program element 
Managers to estimate the minimum and maximum funding 
levels for each major project. Additionally, the 
questionnaire required respondents to make subjective 
comparisons between each program element project 
regarding each of the following factors: 

1) Potential contribution to SDI long range goal 
2) Potential contribution to SDI short range goal 
3) Potential generation of spinoff technology 

4) Technological risk 

5) Milestone risk 

6) Ultimate project success time 

7) FSED contribution time 

8) Concepts and designs balance 

9) Signature requirements/data collection balance 
10)Function performance balance 

11)Technological base balance . 

The survey was designed according to the 
principles of AHP discussed in Chapter IV. The program 
managers compared each major program with all the other 
programs in that same program element on the basis of 
the factors shown above. Respondents were briefed in 
person and in writing on the AHP comparison scale, and 
a definition of each comparison factor was provided. 
The program element managers were given over two months 
(18 Dec 86 - 28 Feb 87) to work on and complete the 
survey. 
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MAJOR PROJECT SURVEY 


WPD: POG. 


This survey is designed to obtain pairwise 


comparison data on all of the WPDs in your program 


element. The projects will be compared on the basis of 
eleven key issues. You have already been briefed on 
the purpose of this survey and it’s theoretical 
foundations. 


Please use the following numerical scale to help ~ 
describe the relationships of the WPDs on the following 


pages: 


- same/equal 
- moderate 
strong 

- very strong 


ODO IC OF COD 
i 


- extremely strong 


-~ intermediate 
values 


Please also ensure that you circle either 


"advantage" or "disadvantage" when each 
made. Questions made be directed to 
USASDC Program Analysis and Evaluation 


CPT Anderson, Naval Postgraduate School. 
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comparison is 
MAJ Donnellon, 


Directorate, or 


Comparison 1: Potential contribution to long range goal 


Definition: Potential for benefiting the overall 
eo loet eat goals of the SDI or strategic defensive 
system. 


In regards to the above comparison, 


gives a _____ advantage/disadvantage over 
= gives a _ advantage/disadvantage over 
gives a ____ advantage/disadvantage over 
gives a __ advantage/disadvantage over 
gives a ___ advantage/disadvantage over 
gives a ___ advantage/disadvantage over 
gives a ___ advantage/disadvantage over 


Comparison 2: Potential contribution to FSED decision 
Definition: 


In regards to 


gives 
gives 
gives 
gives 
gives 
gives 
gives 


Potential BO 
decision not later than 


helping to 
on ets 


the above comparison, 


op © © HP P PM 


advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 


over 
over 
over 
over 
over 
over 


over 


achieve an FSED 


Comparison 3: Potential eneration of militar spinoff 
tecnnol 


Definition: 


militar 
externa 


pene! 


Esohne! ey: 


In regards to 


gives 
gives 
gives 
gives 
gives 


benefit to the 


generation of 


assistance to the military in ways 


R&D program. 


the above comparison, 


a 


a 
a 
a 
a 


advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
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over 
over 
over 
over 


over 


gives a advantage/disadvantage over 


gives a advantage/disadvantage over i 


Comparison 4: Technological risk 


Definition: Likelihood of failing 
technical objectives _of the 
not achieving 


o meet the ultimate 
program/WPD; probability of 
technological success. 


In regards to the above comparison, 


gives a __ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 

gives a ____— advantage/disadvantage over 

gives a ___ advantage/disadvantage over 

gives a ____ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 
Comparison 5: Milestone risk 
Definition: Likelihood of failin to meet the 
milestone schedule needed for an FSED decision in 19958 
robability of not achieving the milestones specified 


y the WPD. 


In regards to the above comparison, 


Comparison 
technol 


gives 
gives 
gives 
gives 
gives 
gives 


gives 


Can 


Definition: 
technical 
resources nee 
available. 


6: 


o op P P P PHP P 


Time required to achieve ultimate 
S66 ol ee 


Time 
objectives 


ed 


advantage/disadvantage 


advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
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over 
over 
over 
over 
over 
over 


over 


needed to achieve the 
of the WPD, 
money, facilities, etc. 


provided that all 


In regar 


ds to 
gives 
gives 
gives 
gives 
gives 
gives 


gives 


the above comparison, 


op © © HP HP HP 


advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 


over 
over 
over 
over 
over 
over 
over 


Comparison 7: Tim UPrecomtommaciileve objective 
require dad~ fOY-FSED-deeisis in 1995°- 


Definition: needed 


°" to achieve onl those 

objectives needed in order to make an informed FSED 
decision by 1995. 
In regards to the above comparison, 

gives a ___ advantage/disadvantage over : 

gives a ____ advantage/disadvantage over 

gives a ____ advantage/disadvantage over 

gives a ____ advantage/disadvantage over 

gives a ____ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 

gives a ____ advantage/disadvantage over 
Comparison 8: Concepts and designs balance 
Definition: Propensity of the project to be in the 
concepts and designs developmental phase. 
In regards to the above comparison, 

gives a ___ _ advantage/disadvantage over 

gives a ___ advantage/disadvantage over__ 

gives a ____ advantage/disadvantage over 

gives a ____ advantage/disadvantage over 

gives a ____ advantage/disadvantage over 

gives a ____ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 
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Comparison Ore signature requirements/data collection 
balan : 


oot Dees Propensity of the prosecr to be in the 
Seas requirements/data collection developmental 
In regards to the above comparison, 

gives a ___. advantage/disadvantage over 

gives a __ advantage/disadvantage over 

gives a ____ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 

gives a _____ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 

gives a __ advantage/disadvantage over 
Comparison 10: Function performance balance 
Definition: Propensity of the project to be in the 
function performance developmental phase. 
In regards to the above comparison, 

gives a __ advantage/disadvantage over 

gives a ___._ advantage/disadvantage over 

gives a __ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 

gives a _ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 

gives a ___ advantage/disadvantage over 


Comparison ii: Technological base balance 


Definition: 
technological 


In regards to 
gives 
gives 


gives 


Propensity of the project 


base developmental phase. 


the above comparison, 


a 


a 


a 


advantage/disadvantage 
advantage/disadvantage 
advantage/disadvantage 
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to be in the 


over 
over 


over 


gives a advantage/disadvantage over 
gives a advantage/disadvantage over 
gives a advantage/disadvantage over 
gives a advantage/disadvantage over 
This completes the survey. Thank you for your time. 


Please return, using the pre-addressed envelope that 
has been provided, to: 


CPT Steven M. Anderson 


Monterey, C 3 
NPS phone: eo 
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APPENDIX D 
AHP SOFTWARE SUPPORT 


This appendix is intended to provide intormatiton we 
the software that was written in order to support the 
GP Model and perform the AHP process, ae tedious 
procedure if performed by hand. 

Once the project surveys had been collected, the 
next step was to utilize the AHP to determine the 
required coefficient weights for the GP model. The 
calculations required to implement the AHP are numerous 
and difficult. APL [Ref. 38] was the computer language 
chosen to perform the AHP calculations, since APL is 
particularly powerful when performing linear algebra 
computations; APL has the capability to direcuie 
manipulate aggregates of data in the form of arrays or 
matrices. 

An APL workspace called "AHP" was written, 
consisting of nine APL functions that perform the wae 
mathematical procedure outlined in Chapter IV. The 
workspace was written on an IBM Personal Computer using 
APL Plus Version 5.0, Statistical Graphics Corporation. 
The workspace was intended to be easy to use and have a 
broad range of applicability, and is printed out in its 
entirety at the end of this appendix. All programs 
were generalized, so that the AHP can be used on any 
subjective data array, not just the USASDC data set 
presembved here. The programs were also designed to be 
INVETaACcCt ve: so that a user is prompted for the 
information needed at the appropriate time, a feature 
that helps avoid confusion and needless repetition. 
The programs’ are also relatively fast, so that changes _ 
in the data can be made and analyzed quickly, a needed 
characteristic for sensitivity analyses. Additionally, 
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the function DESCRIBE gives the utilizer an overview of 
the workspace and the functions contained within, and 
INPUTHOW is a function created to demonstrate the 
proper method for entering pairwise comparison data 
into the other routines. 

The workspace has several key subroutines that 
serve as building blocks for the other routines. The 
main function AHP utilizes four APL functions. MATRIX 
takes given pairwise comparison data and manipulates it 
into the matrix needed by the other workspace 
functions. Additionally, this matrix is printed on the 
terminal screen so that the user can verify that the 
correct data was entered into the routine. EIGENVECTOR 
performs the linear algebra calculations in order to 
produce an eigenvector of ratio scale coefficient 
weights. Consistency Index (CI) and Consistency Ratio 
(CR) values are also calculated and displayed by the 
EIGENVECTOR program. AHPBASE collects all the 
eigenvectors calculated from comparison matrices at 


each particular hierarchical level and for each factor. 


AHPSTAND determines the overall standardized 
eigenvector for the main factor (ie, payoff, risk, 
time, or balance) being analyzed based on the AHPBASE 
eigenvectors at each hierarchical level. For example, 


AHPSTAND made one overall standardized eigenvector for 
risk from the milestone risk and technological risk 
arrays. The main workspace function, AHP, serves 
principally to call up these subroutines’ the correct 
number of times and formats the output.. 

Two additional functions are included in the 
workspace that are noteworthy. SINGLE is a function 
designed to perform the AHP procedure when only one 
comparison matrix is being studied. AHPCHECK allows 
the user to ensure that the AHP is functioning 


0 


COrrecs: bye It is identical to the AHP funetion> exe we 
that it prints the computations made at each step, 
enabling the user can check for accuracy and logic. 

A summary of the functions contained in) tha. 
workspace is shown below: 

1. INPUTHOW - Recommended reading for the first time 
user; demonstrates how to enter matrix data. 

2. AHP - Determines a weight eigenvector for several 
factors at various hierarchical levels. 

3. AHPCHECK - A checking function to ensure that AHP 
is calculating eigenvalues and CRs properly. 

4. AHPSTAND (subroutine) - Determines standardized 
weight eigenvector for elements in comparison 
matrix. 

5. AHPBASE (subroutine) - Collects basic comparison 
matrix data for AHPSTAND subroutine. 

6. SINGLE - Computes a weight eigenvector for 
elements in a single comparison matrix. 

7. EIGENVECTOR (subroutine) - Ascertains matrix 
eigenvector and calculates consistency ratio data. 

8. MATRIX (subroutine) - Creates matrix from input 
values for use by eigenvector. 

The completed surveys were converted into data 
arrays and entered into the AHP function as input. The 
AHP program was used four times, once for each factor. 
The comparison matrices, thelr respectivesgtis and CRs 
as well as the intermediate and final eigenvector for 
each factor was printed in an output file (see Appendix 
Bat This concluded the procedure for determining 
weight values for each project in regards to payoff, 
risk, time, and balance. 
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APPENDIX E 
GOAL PROGRAMMING SOFTWARE SUPPORT 


This appendix includes a discussion of the software 
that was used and developed in order to determine the 
optimal funding level for each of the major project in 
the SDI program being studied. 

The final steps in the GP model solution process 
entailed finding and using a suitable optimizing 
progran. several excellent linear and non-linear 
programming packages are available, such as the Linear 
Interactive Discrete Optimizer (LINDO) [Ref. 39] or the 
General Interactive Optimizer (GINO) [Ref. 40]. Both 
programs are simple and can be used on an IBM PC, but 
they lack the tremendous power and flexibility of the 
recently developed General Algebraic Modelling System 
(GAMS) [Ref. 41]. 

GAMS was written by Brooke, Drud, and Meeraus of 
the Development Research Department, World Bank. It is 
the first optimizing program that uses the special 
mathematical notation called the Backus-Nauer Form 


(BNF). This notation enables the user to write. 
constraint equations in amore generalized and compact 
style than other packages. GAMS also has the 


capability to handle nonlinear and integer programming 
problems. Additionally, since program coding is very 
terse, changes are extremely easy to make, an advantage 
that will be exploited in the next chapter. Dr. 
Richard Rosenthal of the Naval Postgraduate School has 
referred to GAMS as "perhaps the most significant 
development in the field of operations research in the 
last five years" [Ref. 42]. 

A GAMS program was written (see Appendix E) based 
on the GP model of the major projects of the USASDC. 


eel 


For the reader unfamiliar with GAMS procedures, a short 
discussion of this program is appropriate. The SEG 
command establishes a set i, consisting of the WPD 
numbers of the thirty-five projects being modelled. 
There are six PARAMETER statements; the numerical value 
of the minimum and maximum funding level, as well as 
the payoff, risk, time, and balance weight value of 
each project are entered as parameters. SCALARS 
include the total budget available, based on the 
funding strategy, and the weight coefficients for the 
four deviation variables. The decision variable , iam 

representing the money to be spent on the ith project 
in FY 88, is listed under the VARIABLES command. Also 
displayed here are all eight deviation variables and 


the achievement function variables. The POSITIVE 
VARIABLES command ensures non-negativity of all listed 
variables. The coding under the EQUATIONS command is 


in BNF format but includes all the system and goal 
constraints of the GP model. COST refers to the budge 
constraint that cannot be exceeded. PAYOFF, KiSKe 
TIME, and BALANCE each represent a goal constraint. 
OBJDEF is the achievement function. The minimum and 
maximum funding constraints are singleton equations and 
are listed as upper and lower bounds below the 
EQUATIONS section of the program. The final part of 
the coding refers to formatting and output. 

This concluded the data collection and software 
development process. With AHP and GP model properly 
supported, all that remained was to actually run the 
model and analyze the results. 
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x x 
6 GAMS GOAL PROGRAM FORMULATION 3% 
* i . * 
=JEBERBEBRE BERBER BEEBE BEEBE BERR EEHEHRHREBBEEHRHEEBEHHERREGHE 
STITLE GP THESIS - ANDERSON 

SOFFUPPER 


SOFFSYMLIST OFFSYMXREF 
SET I thirty-five major USASDC projects in five program elements 
/B122,B192 »B412 »B532 »B612 »L008,L212,1503,L721,L723, 
D044 ,D076 ,D080 »D047,D1125D119,D083 ,K222 »K623 ,K6249, 
K225 5K323 »K325 »K524¢ ,K321 »5S271,S051,S011,S052 ,S0523, 
$293 53402 »S$091,S102,S281/3 


PARAMETER MIN(I) min funding level for each project - Mdollars 


/B122 6 
B14¢2 2 
-B412 2 
B532 30 
B612 2 
L008 5 
L212 e 
L503 5 
L721 2 
L723 2 
D044 1 
DO76 =—50 
DO8O0 5 
D047 15 
D112 1 
D114 6 
D083 12 
K222 40 
K623 5 
K624 10 
K225 6 
K323 3 
K325 © 
K524¢ G 
K321 35 
$271 25 
S051 15 
Soll 3 
$052 15 
$053 3 
$243 3 
$402 3 
So9l 5 
$102 2 
$281 12/3 


PARAMETER MAX(I) max reqd money in each program - Mdollars 


/Bl22 37 
B142 15 
B412 28 
B532 95 
B612 25 
L008 30 
L212 12 
L503 24 
L721 12 
L723 10 
D044 15 


D076 260 


Doso 25 
DOG7 #855 
D112 8 
D114 20 
DO83s =. 80 
K222 187 
K623 28 
K624 45 
K225 20 
K323 50 
K325 25 
K524¢ 25 
K321 204 
$271 105 
Sso51 20.5 
Soll 13.3 
S052 31 
S053 19.2 
S243 15 
S402 35 
$091 35.5 
$102 20 


S281 159.473 


PARAMETER CORE(I) funds for each program i for core strategy - Mdollars 


/B122 20 
B1¢2 6.2 
B412 S32 
B532 30 
B6l2 vf 
Loos 14.6 
L212 3.7 
L503 8.5 
L721 4.8 
L723 + 
D044 5 
0076 158 
DO80 5 
D047 34.4% 
D112 3 
D114 12 
DO8s3 55 
K222 150 
K623 24 
K624¢ 38 
K225 6 
K323 5 
K325 5 
K524¢ 12 
K321 58 
S271 82.3 
$051- 16.4% 
Soll 10.7 
S052 22.2 
S053 7.3 
S243 9.8 
$402 15.4% 
S091 i3.2 
$102 10 
S281 20.173 
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PARAMETER BASIC(I) fumds for each program i for basic strategy - Mdollars 


/B122 20 
B142 6.2 
B4l2 10 
B532 38.5 
B6l2 7 
Loos 16 
L212 Ss. 
L503 a 
L721 5.1 
L723 4.3 
D044 5 
D076 170.6 
D080 5 
D047 34.4 
Dll2 7 
D11¢ 12 
0083 61 
K222 150 
K623 29 
K624 38 
K225 8 
K323 5 
K325 — 5 
K524 12 
K321 129 
$271 95 
S051 16.4% 
Soll 10.7 
S052 22.2 
S053 7.3 
S243 9.8 
S402 15.4 
So91 15.3 
S102 11.7 
$281 39.373 


PARAMETER ENHANCED(I) funds for each program i for enhanced strategy 


/B122 24.5 
B142 Tia 
B412 10 
B532 51.1 
B612 12.9 
L008 18 
L212 4.2 
L503 10 
L721 5.6 
L723 4.8 
0044 & 
0076 186.5 
0080 5 
D047 37.4 
D112 7 
0114 12 
0083 61 
K222 7 7 
K623 24 
K624 38 
K225 16.6 
K323 25 
K325 5 
K524 14 
K321 19% 
S271 95 
S051 16.4% 


soll 10.7 


S052 22.2 
S053 8.8 
S243 12 
$402 15.4% 
S091 18.6 
$102 14.2 
S281 82.8/3 


PARAMETER EXTENDED(I) fumds for each program i for extended strategy 


/B122 271 
B142 7. 
B412 12.4 
B532 59.9 
B6l2 157 
Loos 19.8 
L212 4.5 
L503 10.6 
L721 6 
L723 5.2 
D044 8 
D076 211.9 
poso 5 
D047 37.4 
D112 7 
D114 12 
0083 - 61 
K222 177 
K623 24 
K62¢ (38 
K225 16.6 
K323 43 
K325 18.4 
K524 20 
K321 194 
S77 95 
S051 18.9 
S011 1255 
S052 25.6 
S053 12 
S243 13.8 
S402 15.4 
S091 21.5 
$102 16.4% 
S281 11z4773 


PARAMETER P(I) payoff weight factor for each program as determined by AHP 


/B122  .024 
B142 .048 

B412 .020 

B532 .044 

B6él2 .006 

Loos .030 

L212 .032 

L503 .037 

L721 .022 : 
E7cse.0ce 

D044 =.060 

D076 .060 

poso =.015 

D047 .032 

D112 .005 

D114 .004 

D083 =. 024 

K222  .067 


TZ 


K623 .005 


K624 .024 
K225 .027 
K323 .027 
K325 .027 
K524¢ .007 
K321 .045 
S271 .045 
S051 .023 
SOll .020 
So52 .025 
$053 .030 
$243 .049 
S402 .019 
SO91 .036 
$102 .020 


S281 .018/3 


PARAMETER R(I) risk weight factor for each program as determined by AHP 


/B122 = =.048 
B14¢2 .007 
B412 .048 
B532 .007 
B61l2 .033 
L008 .028 
L212 .028 
L503 .041 
L721 .023 
L723 .023 
DOG =.009 
DO76 .009 
DO80 .029 
DOG¢7 .010 
D112 .064% 
D114. = «075 
DO8s = .005 
K222 .013 
K623 .082 
K624 .026 
K225 .Oll 
K323 .011 
K325 .010 
K524¢ .066 
K321 .010 
S271 .019 
SO51 .040 
SOll .104¢ 
SO52 .03% 
$053 .012 
$243 .007 
S402 .020 
SOo91l .Ol1l 
$102 .018 


S281 .022/3 


PARAMETER T(I) time weight factor for each project as determined by AHP 


/B122 = .049 
B142 .006 
B412 .049 
B532 .006 
B6él2 .033 
Loos .035 
L212 .035 
L503 .028 
L721 .023 


Wag 


L723 2025 


DOGG = «. 007 
D076 =6.015 
DO8O0 .035 
DO0G7 =.008 
Dl12 .065 
Dll¢G)=—s«w} 065 
D083 = .004 
K222 .021 
K623 .021 
K62¢ .049 
K225 .031 
K323 .031 
K325 .031 
K52¢ .025 
K321 .018 
S271 .019 
2051 .027 
soll .081 
S052. .027 
$053 =.Oll 
$243 .008 
$402 .033 
$091 .016 
$102 .032 


$281 .031/3 


PARAMETER B(I) balance weight factor for each program determined by AHP 


7B122 = .025 
Bi4¢2 .025 
B412 .027 
B532 .033 
B6él2 .033 
Loos .029 
L212 .029 
L503 .029 
L721 .029 
L723 .029 
D044 —s «030 
D076 .027 
D080 3.027 
D0G7 .027 
D112 .030 
D11¢.)—s« «jw. 030 
D083 = «.027 
K222 .036 
K623 .036 
K62¢4 .O21 
K225 .021 
K323 .021 
K325 .021 
K52¢ .036 
K321 .036 
$271 .033 
SsO5r .030 
$011 .030 
S052 .030 
S053 .028 
$243 .024 
S402 .024¢ 
S091 .034% 
$102 .028 


S281 .029/73 


IZ 


SCALARS 


VARIABLES 
x(I) 
PPOS 
PNEG 
RPOS 
RNEG 
TPOS 
TNEG 
BPOS 
BNEG 
DEVIAT 


POSITIVE VARIABLES X, PPOS, 


EQUATIONS 


COST.. 


PAYOFF. 


RISK.. 


TIME.. 


BALANCE 


OBJDEF. 


BUDGET total budget (CORE) in FY 88 Mdollars /882.6/ 
WTPNEG weight of payoff neg deviation in OBJDEF /.250/ 
WTRPOS weight of risk pos deviation in OBJDEF 4.2507 
WITPOS weight of time pos deviation in OBJDEF 4.2507 
WTBNEG weight of balance neg deviation in OBJDEF /.250/3 


money to be spend in each program during FY8&8 


positive deviation 
negative deviation 
positive deviation 
negative deviation 
positive deviation 
negative deviation 
positive deviation 
negative deviation 
ION deviation from the 


from 
from 
from 
from 
from 
from 
from 
from 


the 


payoff goal constraint 
payoff goal constraint 
risK goal constraint 
risk goal constraint 
time goal constraint 
time goal constraint 
balance goal constraint 
balance goal constraint 


objective function; 


PNEG, RPOS, RNEG, TPOS, TNEG» BPOS, BNEG; 


COST cost of programs cannot exceed the budget 
PAYOFF goal number 1 - maximize payoff 
RISK goal mumber 2 - minimize risk 
TIME goal munber 3 - minimize time 
BALANCE goal rumber 4 - maximize balance 
OBJDEF achievement function; 
SUM (I, X(I)) =L= BUDGET; 
. SUM (I, X(I)} * P(I)) - PPOS + PNEG 
=E= SUM (I, P(I) * MAX(I))3 
SUM (I, X(I) * R(I)) - RPOS + RNEG 
=E= SUM (I, RII) * MIN(I))3 
SUM (I, X(I) * T(I)) - TPOS + TNEG 
=E= SUM (I, T(I) * MIN(I))3 
ae SUM (I, X(I) * B(I)) - BPOS + BNEG 
=sE= SUN (I, B(I) * MAX(I))3 
° (WTPNEG * PNEG) + (WTRPOS * RPOS) + 


(WTTPOS * TPOS) + (WTBNEG * BNEG) =E= DEVIATION; 


* additional constraints involving max and min funding levels 


MODEL GP 


SOLVE GP USING LP MINIMIZING DEVIATION; 


X.LO(I) = MIN(I) 


x. UP(T) MAX(T) 


ZALL/3 
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5 


5 


PARAMETER REPORT1 (1I,%) 


comparision of optima with funding level; 


REPORT1 (I, ‘MINIMUM’') = MIN(TI)35 

REPORT1 (I, ‘OPTIMUM') = X.L(I)5 

REPORT (I, ‘CORE’) = CORE(TI)3 

REPORT (I, ‘DIFF*) = X.L(I) - CORE(T)3 

REPORT (I, '% DIFF') = (X.L(I) - CORECI)I/CX.LII) D5 
REPORT1 (I, *MAXIMUM') = MAX(TI)3 


PARAMETER REPORT2 (%*) listing of goal 


constraint RHS targets; 


REPORT2 (‘TARGET 1°) = SUM (I, P(I) * MAX(I))3 
REPORT2 (‘TARGET 2°) = SUM (I, R(I) * MIN(I))3 
REPORT2 (‘TARGET 3°) = SUM (I, T(I) *® MIN(I))35 
REPORT2Z (‘TARGET 4°) = SUM (I, B(I) * MAX(I))3 


PARAMETER REPORTS (*) least squares and average deviation figures}; 


REPORTS (‘LST SQRS') = SUM (I,SQR(X.L(I) - CORE(I))J)3 
REPORTS (‘AVE DEV’) = (SUM (I,(0(X.L(I )-CORE(I))/(%.L(1)))))/353 
PARAMETER REPORT (*) total budget checks 
REPORTS (‘TOTAL BGT’) = SUM (I,X.L(I)) 
DISPLAY REPORTS} 
DISPLAY REPORT13 
DISPLAY REPORT2}3 


DISPLAY REPORT33 
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APPENDIX F 
AHP OUTPUT 


The APL workspace discussed in Chapter VI and shown 
in Appendix F was used to determine the coefficients 
for the goal constraint equations in the main GP 
program. The AHP program in the workspace was run four 
different times to calculate payoff, risk, time, and 


balance weights for each project. In the interest of 
brevity, only the comparison matrices, consistency 
ratio information, and eigenvectors from the payoff 


factor output are displayed on the following pages. 
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FACTOR: POTENTIAL CONTRIBUTION TO SDI 
GROUP : SABM PROJECTS 


COMPARISON MATRIX 


1.000 1.000 2.000 1.000 5.000 
1.000 1.000 2.000 1.000 5.000 


-500 -500 1.000 1.000 5.000 
1.000 1.000 1.000 1.000 5.000 
- 200 200 200 .200 1.000 


LAMBDA( MAXIMUM): 5.078 
CONSISTENCY INDEX: .019 
CONSISTENCY RATIO: .017 


WEIGHT EIGENVECTOR: -269 .269 .181 .234¢ .047 
STANDARDIZED WEIGHTS: .038 .038 .026 .033 .007 


FACTOR: POTENTIAL CONTRIBUTION TO SDI 
GROUP ; SLKT PROJECTS 


COMPARISON MATRIX 


1.000 1.000 1.000 3.000 3.000 
1.000 1.000 1.000 3.000 3.000 
1.000 1.000 1.000 3.000 3.000 
333 «333 333 1.000 1.000 
333 333 333 1.000 1.000 


LAMBDA( MAXIMUM ): 5.000 
CONSISTENCY INDEX: .000 
CONSISTENCY RATIO: .000 


WEIGHT EIGENVECTOR: 62/5 «2/5 gelo 20S. 09) 
STANDARDIZED WEIGHTS: .039 .039 .039 .013 .013 


FACTOR: POTENTIAL CONTRIBUTION TO SDI 
GROUP ; DEW PROJECTS 


COMPARISON MATRIX 


1.000 1.000 7.000 3.000 8.000 9.000 
1.000 1.000 7.000 3.000 8.000 9.000 


193 193 1.000 -250 5.000 6.000 
333 -333 ¢.000 1.000 5.000 6.000 
225 ~125 - 200 200 1.000 4.000 
oa bl ors ~167 167 250 1.000 
333 -333 4.000 1.000 7.000 9.000 


LAMBDA( MAXIMUM ): 7.648 
CONSISTENCY INDEX: .108 
CONSISTENCY RATIO: .082 


ey 


3.000 
3.000 
- 250 
1.000 
193 
e111 
1.000 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


303 
-061 .061 


-303 .064 .132 
-013 .026 


.032 .019 .148 
-006 .00¢ .030 


FACTOR: POTENTIAL CONTRIBUTION TO SOI 
GROUP : KEW PROJECTS 
COMPARISON MATRIX 
1.000 9.000 9.000 3.000 3.000 3.000 5.000 
e111 1.000 333 193 143 - 143 - 200 
lll 3.000 1.000 1.000 1.000 1.000 5.000 
333 7.000 1.000 1.000 1.000 1.000 5.000 
333 7.000 1.000 1.000 1.000 1.000 5.000 
333 7.000 1.000 1.900 1.000 1.000 5.000 
-200 5.000 -200 - 200 200 - 200 1.000 
1.000 9.000 3.000 3.000 3.000 3.000 5.000 
LAMBDA( MAXIMUM }: 8.628 
CONSISTENCY INDEX: .090 
CONSISTENCY RATIO: .064¢ 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


-303 .019 .087 .104¢ 
-069 .00¢ .020 .02¢ 


-10G .10¢ .037 
-024¢ .02¢ .008 


FACTOR: POTENTIAL CONTRIBUTION TO SDI 
GROUP : SATKA PROJECTS 
COMPARISON MATRIX 
1.000 3.000 3.000 3.000 3.000 2.000 3.000 
333 1.000 1.000 1.000 1.000 333 2.000 
333 1.000 1.000 1.000 3.000 333 2.900 
333 1.000 1.000 1.000 2.000 333 2.000 
333 1.000 333 - 500 1.000 333 1.000 
- 500 3.000 3.000 3.000 3.000 1.000 4.000 
333 -500 - 500 500 1.000 ~250 1.000 
333 1.000 333 2.000 1.000 -500: 2.000 
- 250 500 333 -500 333 333 -500 
ooo 333 333 -500 - 500 - 250 1.000 
LAMBDA( MAXIMUM): 10.578 
CONSISTENCY INDEX: .064¢ 
CONSISTENCY RATIO: .043 


.226 .086 .118 .084 .068 .195 .052 
-065 .025 .034¢ .02¢ .020 .056 .015 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 
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1.000 
pa kid: 
333 
333 

3.00 
eSo5 
-200 

1.000 


o 243 
e 055 


3.000 
1.000 
3.000 
- 500 
1.000 
2.000 
-500 
1.000 
-500 
- 500 


4.000 
2.000 
3.000 
2.000 
3.000 
3.000 
2.000 
2.000 
1.000 
3.000 


.085 .037 .049 
-02¢ .011 .014% 


= 


Nr ANNWWW 


ssssss== 
ELEMENTS 


m 
— 
@ 
2 
m 
oO 
+ 
Oo 
a 
wT} 
oO 
a it 


HIERARCHICAL LEVEL: PAYOFF 
FACTOR: POTENTIAL CONTRIBUTION TO SDI 


EIGENVECTOR: .038 .038 .026 .033 .007 .039 .039 .039 .013 .013 .061 .061 .013 
-026 .006 .00¢%¢ .030 .069 .00% .020 .02% .02% .02¢4¢ .008 .055 .065 .025 .03 
4 .02% .020 .056 .015 .024¢ .011 .014¢ 


CHECK--SUM OF VECTORS ELEMENTS SHOULD EQUAL 1.0 


FACTOR: POTENTIAL CONTRIBUTION TO FSED DECISION 
GROUP : SABM PROJECTS 
COMPARISON MATRIX 
1.000 333 1.000 -333 5.000 
3.000 1.000 5.000 1.000 5.000 
1.000 - 200 1.000 333 5.000 
3.000 1.000 3.000 1.000 5.000 
- 200 200 200 200 1.000 


LAMBDA MAXIMUM ): 5.278 
CONSISTENCY INDEX: .070 
CONSISTENCY RATIO: .062 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


2136 .371 .126 .323 .045 
-019 .053 .018 .0%6 .006 


FACTOR: POTENTIAL CONTRIBUTION TO FSED DECISION 
GROUP: SLKT PROJECTS 
COMPARISON MATRIX 
1.000 1.000 1.000 3.000 3.000 
1.9000 1.000 1.000 3.000 3.000 
1.000 1.000 1.000 3.000 3.000 
333 ~333 333 1.000 1.900 
~ 333 333 333 1.000 1.000 
LAMBD At MAXIMUM ): 5.000 
CONSISTENCY INDEX: .000 
CONSISTENCY RATIO: .000 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


0273 .273 1.273 «091 .O9] 
-039 .039 .039 .013 .013 
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FACTOR: POTENTIAL CONTRIBUTION TO FSED DECISION 
GROUP: DEW PROJECTS 
COMPARISON MATRIX 
1.000 1.000 7.000 3.000 9.000 9.000 3.000 
1.000 1.000 7.000 3.000 9.000 9.000 3.000 
~ 143 143 1.000 - 250 6.000 6.000 -250 
333 -333 %.000 1.000 8.000 8.000 1.000 
elt] ~11l 167 eee 1.000 3.000 lll 
aa 111 167 ~125 333 1.000 ~125 
333 -333 %.000 1.000 9.000 8.000 1.000 
LAMBDA( MAXIMUM ): 7.638 
CONSISTENCY INDEX: .106 
CONSISTENCY RATIO: .081 


-302 .302 .063 .143 .025 .018 .14%6 
-060 .060 .013 .029 .005 .004 .029 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


FACTOR: POTENTIAL CONTRIBUTION TO FSED DECISION 
GROUP : KEW PROJECTS 
COMPARISON MATRIX 
1.000 9.000 9.000 3.000 3.000 3.000 5.000 1.000 
ill 1.000 333 143 143 143 «200 lll 
lll 3.000 1.000 1.000 1.000 1.000 5.000 1.000 
335 7.000 1.000 1.000 1.000 1.000 5.000 1.000 
333 7.000 1.000 1.000 1.000 1.000 5.000 1.000 
333 7.000 1.000 1.000 1.000 1.000 5.000 1.000 
-200 5.000 200 - 200 - 200 - 200 1.000 - 200 
1.000 9.000 1.000 1.000 1.000 1.000 5.000 1.000 
LAMBDA( MAXIMUM ): 8.665 
CONSISTENCY INDEX: .095 
CONSISTENCY RATIO: .067 


-329 .019 .103 .120 .120 .120 .037 .150 
-075 .00%¢ .024 .028 .028 .028 .008 .034¢ 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


FACTOR: POTENTIAL CONTRIBUTION TO FSED DECISION 
GROUP ; SATKA PROJECTS 
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COMPARISON MATRIX 


1.000 3.000 3.000 3.000 3.000 1.000 3.000 3.000 3.000 2.00 
333 1.000 2.000 1.000 2.000 - 500 2.000 1.000 2.000 2.00 
333 - 500 1.000 333 . 500 . 250 -500 -500 2.000 2.00 
333 1.000 3.000 1.000 2.000 333 2.000 - 500 2.000 2.00 
333 -500 2.000 -500 1.000 -500 1.000 1.000 2.000 1.00 

1.000 2.000 4.000 3.000 2.000 1.000 3.000 2.000 3.000 2.00 
~ 333 »- 500 2.000 -500 1.000 +333 1.000 - 500 2.000 1.00 
333 1.000 2.000 2.000 1.000 - 500 2.000 1.000 2.000 -50 
355 - 500 -500 - 500 - 500 333 - 500 - 500 1.000 33 
500 500 -500 -500 1.000 - 500 1.000 2.000 3.000 1.00 

LAMBOA( MAXIMUM): 10.633 
CONSISTENCY INOEX: .070 
CONSISTENCY RATIO: .047 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


.202 .103 .058 .101 .073 .182 .065 .09% .042 .080 
-058 .029 .017 .029 .021 .052 .019 .027 .012 .023 


HIERARCHICAL LEVEL: PAYOFF 
FACTOR: POTENTIAL CONTRIBUTION TO FSEO DECISION 


EIGENVECTOR: .019 .053 .018 .046 .006 .039 .039 .039 .013 .013 .060 .060 .013 
.029 .005 .00¢4¢ .029 .075 .004¢ .02% .028 .028 .028 .008 .034 .058 .029 .0O1 
7 .029 .021 .052 .019 .G27 .O012 7.025 


CHECK--SUM OF VECTORS ELEMENTS SHOULD EQUAL 1.0 


FACTOR: POTENTIAL GENERATION OF SPINOFF TECHNOLOGY 
GROUP: SABM PROJECTS 
COMPARISON MATRIX 

1.000 ~200 1.000 200 5.000 

5.000 1.000 5.000 1.000 5.000 

1.000 - 200 1.000 - 200 5.000 

5.000 1.000 5.000 1.000 5.000 

- 200 - 200 -200 200 1.000 
LAMBDA( MAXIMUM ): 5.434 
CONSISTENCY INDEX: .108 
CONSISTENCY RATIO: .097 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


~106 .372 .106 .372 .043 
-015 .053 .015 .053 .006 


ge 


FACTOR: POTENTIAL GENERATION OF SPINOFF TECHNOLOGY 
GROUP: SLKT PROJECTS 
COMPARISON MATRIX 

1.000 1.000 333 533 -333 

1.000 1.000 1.000 333 333 

3.000 1.000 1.000 1.000 1.000 

3.000 3.000 1.000 1.000 1.000 

3.000 3.000 1.000 1.000 1.000 
LAMBDA( MAXIMUN ): 5.151 
CONSISTENCY INDEX: .038 
CONSISTENCY RATIO: .034 


.093 .122 .230 .278 .278 
-013 .017 .033 .040 .040 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


FACTOR: POTENTIAL GENERATION OF SPINOFF TECHNOLOGY 
GROUP: DEW PROJECTS 
COMPARISON MATRIX 
1.000 1.000 3.000 2.000 9.000 9.000 6.000 
1.000 1.000 3.000 2.000 9.000 9.000 6.000 
555 55 1.000 »333 4.000 4¢.000 2.000 
- 500 - 500 3.000 1.000 9.000 9.000 4.000 
lll lll 250 ~lll 1.000 1.000 - 200 
lll elll 250 lll 1.000 1.000 200 
-167 -167 -500 250 5.000 5.000 1.000 
LAMBDA( MAXIMUM }: 7.260 
CONSISTENCY INDEX: .043 
CONSISTENCY RATIO: .033 


-292 .292 .095 .205 .024 .024 .069 
-058 .058 .019 .04¢1 .005 .005 .014 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


FACTOR: POTENTIAL GENERATION OF SPINOFF TECHNOLOGY 
GROUP : KEW PROJECTS 
COMPARISON MATRIX 
1.000 9.000 1.000 3.000 3.000 3.000 9.000 
lll 1.000 ~1l1l - 250 - 250 . 250 1.000 
1.000 9.000 1.000 1.000 1.000 1.000 3.000 
333 4.000 1.000 1.000 1.000 1.000 9.000 
333 4.000 1.000 1.000 1.000 1.000 9.000 
333 4.000 1.000 1.000 1.000 1.000 9.000 
elll 1.000 333 lll lll lll 1.000 
1.000 9.000 4.000 1.000 1.000 1.000 9.000 


ne, 


1.000 
~lll 
250 

1.000 

1.000 

1.000 
~lll 

1.000 


LAMBDA ( MAXIMUM): 
CONSISTENCY INDEX: 
CONSISTENCY RATIO: 


8.536 
077 
054 


WEIGHT EIGENVECTOR: 
STANDARDIZED WEIGHTS: 


-248 .024 .127 .126 .126 .126 .021 .204 
-057 .005 .029 .029 .029 .029 .005 .047 


FACTOR: POTENTIAL GENERATION OF SPINOFF TECHNOLOGY 
GROUP: SATKA PROJECTS 
COMPARISON MATRIX 
1.000 1.000 1.000 -500 333 333 -500 333 -500 1.00 
1.000 1.000 1.000 1.000 - 333 250 -500 333 -500 -50 
1.000 1.000 1.000 250 - 250 200 -500 200 333 -50 
2-000 1.000 4.000 1.000 -500 333 - 500 -500 - 500 2.00 
3.000 3.000 4.000 2.000 1.000 2.000 3.000 - 500 2.000 3.00 
3.000 4.000 5.000 3.000 - 500 1.000 2.000 - 500 -500 3.00 
2.000 2.000 2.000 2.000 333 . 500 1.000 .333 -500 1.00 
3.000 3.000 5.000 2.000 2.000 2.000 3.000 1.000 2.000 3.00 
2.000 2.000 3.000 2.000 -500 2.000 2.000 . 500 1.000 3.00 
1.000 2.000 2.000 -500 333 333 1.000 -333 ~333 1.00 
LAMBDA( MAXIMUM): 10.494 
CONSISTENCY INDEX: .055 
CONSISTENCY RATIO: .037 


WEIGHT EIGENVECTOR: -049 .048 .036 .079 .174 .141 .078 .204 .133 .058 


STANDARDIZED WEIGHTS: .01¢ .01¢ .010 .022 .050 .040 .022 .058 .038 .017 
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HIERARCHICAL LEVEL: PAYOFF 
FACTOR: POTENTIAL GENERATION OF SPINOFF TECHNOLOGY 


EIGENVECTOR: .015 .053 .015 .053 .006 .013 .017 .033 .040 .040 .058 .058 .019 
-041 .005 .005 .01¢ .057 .005 .029 .029 .029 .029 .005 .047 .014¢ .01¢ .01 
0 .022 .050 .0¢0 .022 .058 .038 .017 


CHECK--SUM OF VECTORS ELEMENTS SHOULD EQUAL 1.0 


SUM = 1.0000 
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TROL HEE IEE IE FOIE FEI EEE FETE IEE FETE FETE TE FEE FETE EEE EEE IEE EFF 


FINAL AHP DATA 
FRIESE IEEE ETE FE FE FETE FETE FE EEE FE FE FESE HEFL FEE FE SE FE FE SE FE FETE FETE ME FIE SESE FETE EME FE FE FEFE FE, 
FIFI IEEE IE EDEN EE FEE FETE FETE EFE DE HEE IE FETE EDIE FE HEHE HEHE FE FEE FEE DEDEFE SE HE FEEL IE FETE FEE FEE IEE PEPE IESE IEEE FETE 


HIERARCHICAL LEVEL: PAYOFF 
NUMBER OF FACTORS: 3 
STANDARDIZED EIGENVECTOR - ALL ELEMENTS 


-02¢ .04¢8 .020 .044 .006 .030 .032 .037 .022 .022 .060 .060 .015 .032 .005 .00 
G .02%¢ .067 .005 .02¢ .027 .027 .027 .007 .04¢5 .045 .023 .020 .025 .030 . 
0¢9 .019 .036 .020 .018 
CHECK - SUM OF VECTOR ELEMENTS SHOULD EQUAL 1.0 
SUM = 1.0000 


FHI IEE IEEE IEE EEE TEI IEEE HEE NE HE FEE TEESE TE FE FEE FEFE HEE FE HEME DEBE PEE TEDETHENE HE FETE DEDEDE TE HEE SEE FE HEHE PE FEE HE FETE FE, 
FHI IIE HEE EEE IEE FETE IIE EEE IEEE FETE HE ESE THE FE IE TIE FE FE TEESE FE FETE FETE TE FEE IEE ETE IE IE HE FIE NE TE FE FE IE 
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APPENDIX G 
GAMS OUTPUT 


The GAMS nonlinear programming package produces an 
extensive and voluminous output listing for every model 


run. The GP model required that model iterations be 
performed for each of the four different budget 
Stracesies. The following four pages contains a 


condensed and curtailed solution summary for’ the model 
runs at the core, basic, enhanced, and extended budget 
levels. 
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sOUVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER SBDMLP FROM LINE ¢50 
seeset SOLVER STATUS 1 NORMAL COMPLETION 
see MODEL STATUS 1 OPTIMAL 
set OBJECTIVE VALUE 16.6951 
LOWER LEVEL UPPER MARGINAL 
---- EQU COST -INF 882.600 882.600 -0.021 
~--- EQU PAYOFF 68.259 68.259 68.259 0.527 
eo-- EQU RISK 7.143 7.143 7.143 -0.301 
---- EQU TIME 72793 73195 ia fo> -0.110 
s--- EQU BALANCE 52.861 52.861 52.861 0.063 
---- EQU OBJDEF . . ° -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER ¢ - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88 
LOWER LEVEL UPPER MARGINAL 
Bl122 6.000 6.000 37.000 0.027 
B14¢2 2.000 15.000 15.000 -0.003 
B12 9.000 9.000 28.000 0.029 
B532 30.000 95.000 95.000 -0.002 
B612 2.000 2.000 25.000 0.029 
LOO8 5.000 5.000 30.000 0.016 
L212 2.000 2.000 12.000 0.015 
L503 5.000 5.000 24.000 0.015 
L721 2.000 2.000 12.000 0.017 
L723 2.000 2.000 10.000 0.017 
D044 1.000 15.000 15.000 -0.009 
D076 50.000 260.000 260.000 -0.008 
DO80 5.000 5.000 25.000 0.024 
DO¢7 15.000 15.000 55.000 0.006 
D1ll2 1.000 1.000 8.000 0.043 
D114 6.000 6.000 20.000 0.047 
D083 12.000 12.000 80.000 0.009 
K222 40.000 187.000 187.000 -0.010 
K623 5.000 5.000 28.000 0.043 
K629 10.000 10.000 45.000 0.020 
K225 6.000 6.000 20.000 0.012 
K323 3.000 3.000 50.000 0.012 
K325 4.000 4.000 25.000 0.012 
K52% 4.000 4.000 25.000 0.038 
K321 35.000 108.600 20¢.000 ° 
$271 25.000 25.000 105.000 0.003 
S051 15.000 15.000 20.500 0.022 
Soll 3.000 3.000 13.300 0.049 
S052 15.000 15.000 31.000 0.019 
S053 3.000 3.000 19.200 0.008 
$293 3.000 15.000 15.000 -0.003 
$402 3.000 3.000 35.000 0.019 
Sso9l 5.000 5.000 35.500 0.005 
$102 2.000 2.000 20.000 0.018 
$281 12.000 12.000 159.%00 0.020 
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os OTE, V.e SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 


SOLVER BOMLP FROM LINE 450 


weet SOLVER STATUS 1 NORMAL COMPLETION 


set MODEL STATUS 1 OPTIMAL 
wee OBJECTIVE VALUE 13.7734 

LOWER LEVEL UPPER MARGINAL 
~--~- EQU COST ~INF 1029.100 1029.100 -0.018 
~-~-- EQU PAYOFF 68.259 68.259 68.259 0.527 
---- EQU RISK 7.143 7.143 7.143 -0.301 
--~-- EQU TIME 7.793 7.793 7.793 -0.110 
~--- EQU BALANCE 52.861 52.861 52.861 0.063 
wa we EQU OBJDEF ° ° e -1.000 

COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 


PAYOFF GOAL NUMBER 1 ~ MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4 ~- MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
~--- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88 
LOWER LEVEL UPPER ' MARGINAL 
B122 6.000 6.000 37.000 0.024 
B142 2.000 15.000 15.000 -0.006 
B412 9.000 9.000 28.000 0.026 
B532 30.000 95.000 95.000 -0.005 
B612 2.000 2.000 25.000 0.026 
L008 5.000 5.000 30.000 0.013 
L212 2.000 2.000 12.000 0.012 
L503 5.000 5.000 24.000 0.012 
L721 2.000 2.000 12.000 0.014 
L723 2.000 2.000 10.000 0.014 
D044 1.000 15.000 15.000 =0-012 
0076 50.000 260.000 260.000 “0.011 
DO80 5.000 5.000 25.000 0.021 
0047 15.000 15.000 55.000 0.003 
Dll2 1.900 1.000 8.000 0.040 
D114 6.000 6.000 20.000 0.044 
DO83 12.000 12.000 80.000 0.006 
K222 40.000 187.000 187.000 -0.013 
K623 5.000 5.000 28.000 0.040 
K624¢ 10.000 10.000 45.000 0.017 
K225 6.000 6.000 20.000 0.009 
K323 3.000 3.000 50.000 0.009 
K325 4.000 4.000 25.000 0.009 
K524¢ 4.000 4.000 25.000 0.035 
K321 35.000 204.000 204.000 -0.003 
$271 25.000 76.100 105.000 : 
$051 15.900 15.000 20.500 0.019 
Soll 3.000 3.000 13.300 0.0%6 
S052 15.000 15.000 31.000 0.016 
$053 3.000 3.000 19.200 0.005 
$243 3.000 15.000 15.000 -0.006 
$402 3.000 3.000 35.000 0.016 
Sogl 5.000 5.000 35.500 0.002 
$102 2.000 2.000 20.000 0.015 
$281 12.000 12.000 159.400 0.017 


142 


SOLVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BOMLP FROM LINE 450 
sane SOLVER STATUS 1 NORMAL COMPLETION 
weet MODEL STATUS 1 OPTIMAL 
wee OBJECTIVE VALUE 10.7438 
LOWER LEVEL UPPER MARGINAL 
~--- EQU COST ~INF 1255.400 1255.4%00 -0.009 
~--- EQU PAYOFF 68.259 68.259 68.259 0.527 
o--- EQU RISK 7.143 7.143 7.143 -0.301 
wn--- EQU TIME 7.793 7.793 7.793 -0.110 
w--- EQU BALANCE 52.861 52.861 52.861 0.063 
---- EQU OBJDEF . : . -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER @ = MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
~--- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY8S8 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.014% 
B142 2.000 15.000 15.000 -0.015 
B412 9.000 9.000 28.000 0.016 
B532 30.000 95.000 95.000 -0.01¢ 
B612 2.000 2.000 25.000 0.017 
Loos 5.000 5.000 30.000 0.003 
L212 2.000 2.000 12.000 0.002 
L503 5.000 5.000 24.000 0.003 
L721 2.000 2.000 12.000 0.005 
L723 2.000 2.000 10.000 0.005 
D044 1.000 15.000 15.000 -0.021 
D076 50.000 260.000 260.000 -0.020 
DO8s0 5.000 5.000 25.000 0.012 
D047 15.000 55.000 55.000 -0 .006 
D112 1.000 1.000 8.000 0.031 
011% 6.000 6.000 20.000 0.035 
D083 12.000 80.000 80.000 -0.004% 
Reece 40.000 187.000 187.000 -0.023 
K623 5.000 5.000 28.000 0.031 
K62¢ 10.000 10.000 45.000 0.008 
K225 6.000 20.000 20.000 EPS 
K323 3.000 10.700 50.000 . 
K325 4.000 25.000 25.000 -3.010E-4 
K524% 4.000 4.000 25.000 0.025 
K321 35.000 204.000 204.000 -0.012 
$271 25.000 105.000 105.000 -0.009 
S051 15.000 15.000 20.500 0.010 
Soll 3.000 3.000 13.300 0.037 
3052 15.000 15.000 31.000 0.007 
S053 3.000 19.200 19.200 -0 .004¢ 
S243 3.000 15.000 15.000 -0.016 
S402 3.000 3.000 35.000 0.007 
Sog9l 5.000 35.500 35.500 -0.007 
$102 2.000 2.000 20.000 0.005 
$28l 12.000 12.000 159.400 0.008 
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> GO Ey —E SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BOMLP FROM LINE 450 
sae SOLVER STATUS 1 NORMAL COMPLETION 
saeexe MODEL STATUS 1 OPTIMAL 
sae OBJECTIVE VALUE 9. 9588 
LOWER LEVEL UPPER MARGINAL 
---- EQU COST ~INF 1383.400 1383.400 -0.003 
---- EQU PAYOFF 68.259 68.259 68.259 0.527 
==== EQUURISN 7.143 7.193 7.143 -0.301 
---- EQU TIME Vil o> 7.793 7.793 -0.110 
--=-- EQU BALANCE 52.861 52.861 52.861 0.063 
---- EQU OBJDEF : : ; -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4 - MAXIMIZE BALANCE 
OBJOEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY8S 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.009 
B142 2.000 15.000 15.000 =O; 02. 
BG12 9.000 9.000 28.000 0.011 
BS532 30.000 95.000 95.000 -0.019 
Bél2 2.000 2.000 25.000 0.012 
L008 5.000 30.000 30.000 -0.002 
tei2d 2.000 12.000 12.000 -0.003 : 
L503 5.000 24.000 24.000 -0.003 
evel 2.000 12.000 12.000 -6.020E-% 
L723 2.000 10.000 10.000 -6.020E-4 
D044 1.000 15.000 15.000 -0.027 
0076 50.000 260.000 260.000 -0.026 
0080 5.000 5.000 25.000 0.006 
D0G7 15.000 55.000 55.000 -0.011 
0112 1.000 1.000 8.000 0.025 
D114 6.000 6.000 20.000 0.029 
D083 12.000 80.000 80.000 -0.009 
K222 40.000 187.000 187.000 -0'.028 
K623 5.000 5.000 28.000 0.025 
K62% 10.000 10.000 45.000 0.003 
K225 6.000 20.000 20.000 -0.005 
K323 3.000 50.000 50.000 -0.005 
K325 4.000 25.000 25.000 -0.006 
K524% 4.000 4.000 25.000 0.020 
K321 35.000 204.000 204.000 -0.018 
S271 25.000 105,000 105.000 -0.015 
so51 15.000 15.000 20.500 0.004 
soll 3.000 3.000 13.300 0.031 
S052 15.000 15.000 31.000 0.002 
S053 3.000 19.200 19.200 -0.009 
$243 3.000 15.000 15.000 -0.021 
S402 3.000 3.000 35.000 0.001 
$091 5.000 35.500 35.500 -0.013 
$102 2.000 18.700 20.000 : 
S281 12.000 12.000 159.400 0.002 
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APPENDIX H 
AHP OUTPUT - SENSITIVITY ANALYSIS 


In Chapter VII a sensitivity analysis was conducted 
em the GP model. In order to test the impact of 
changes in the achievement function coefficient 
weights, several modelling situations were envisioned. 
The function SINGLE was run in the AHP workspace on 
each of these four’ situations, and the output from 
these iterations is contained on the following pages. 
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SSAssreresssssesesssssssssese2see2esee2e22222222222= 
SITUATION 1 


LAMBDA ( MAXIMUM ): 4.016 
CONSISTENCY INDEX: .005 
CONSISTENCY RATIO: .006 


WEIGHT EIGENVECTOR: .425 .425 .093 .056 


a =D aes ee es es es os a ae Se aw oo oe aw 68 ow oe ae ae 6 @® @® o 6 @® @® 6 @® 6 @® @® @® oe ot @® 6 ew ow ot oe oe os oe 
BOOS Sea as SF SF SSF SOSOBa Bae SF SOS Ss se Ser FFB SF SF SF SO SF SF SF SF SF SF SB SF SF SF SF SF SS S&S |S SS 


1.000 500 5.000 7.000 
2.000 1.000 7.000 9.000 
200 143 1.000 2.000 
~ 143 ~lll - 500 1.000 


LAMBDA( MAXIMUM ): 4.040 
CONSISTENCY INDEX: .013 
CONSISTENCY RATIO: .015 


WEIGHT EIGENVECTOR: .330 .542 .079 .048 


= @2 @8 @® oe G8 ae om om @® oe o® @ Of ow of ae oe ow oo oe oe oo oe oe o® 8 o@® om om ae oo om © © & ow oe © oe © oe © ot ot oe =O 
= =® =) O22 8 ae oF @ aw 6 6 6 6 6b 6 @® © 6 oe 6 @® 6 6 ew 2 ee 6 6 @® of @® 68 @® aw @® 28 aw 28 28 28 28 28 oe OF OS oP OD 


LAMBDA( MAXIMUM ); 4.104 
CONSISTENCY INDEX: .035 
CONSISTENCY RATIO: .039 


WEIGHT EIGENVECTOR: .250 .152 .557 .041 


1.000 1.000 1.000 1.000 
1.000 1.000 1.000 1.000 
1.000 1.000 1.000 1.000 
1.000 1.000 1.000 1.000 


LAMBDA( MAXIMUM): 4.000 
CONSISTENCY INDEX: .000 
CONSISTENCY RATIO: .000 


WEIGHT EIGENVECTOR: .250 .250 .250 .250 
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APPENDIX I 
GAMS OUTPUT - SENSITIVITY ANALYSIS 


The sensitivity analysis conducted in Chapter VII 
involved modelling four distinct situations involving 
fluctuations in the achievement function coefficient 
weights. Four situations were run on the GAMS GP model 
at each of the four budget strategies, so a total of 
sixteen model iterations were performed for’ the 
sensitivity analysis. The abbreviated GAMS output for 
each of these iterations is contained on the following 


pages. 


147 


> 0 LEAVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 


sane SOLVER STATUS 1 NORMAL COMPLETION 
seeee MODEL STATUS 1 OPTIMAL 
swaeet OBJECTIVE VALUE 14.5967 
LOWER LEVEL UPPER MARGINAL 
ee-- EQU COST -INF 882.600 882.600 -0.015 
“--- EQU PAYOFF 68.259 68.259 68.259 0.425 
wn-- EQU RISK. 7.143 7.193 7.1943 “0.425 
eo== EGU TIME 16195 7.793 7.793 -0.093 
“<-> EQU BALANCE 52.861 52.861 52.861 0.056 
---- EQU OBJDEF . . . -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER @ - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
“--- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88& 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.029 
B142 2.000 15.000 15.000 -0.003 
B412 9.000 9.000 28.000 0.030 
B532 30.000 95.000 95.000 -0.002 
Bél2 2.000 2.000 25.000 0.028 
Loos 5.000 5.000 30.000 0.016 
L212 2.000 2.000 12.000 0.015 
L503 5.000 5.000 24.000 0.018 
E721 2.000 2.000 12.000 0.016 
L723 2.000 2.000 10.000 0.016 
D044 1.000 15.000 15.000 -0.007 
DO76 50.000 260.000 260.000 -0.007 
DO8O 5.000 5.000 25.000 0.023 
D047 15.000 15.000 55.000 0.005 
D112 1.000 1.000 8.000 0.045 
D114 6.000 6.000 20.000 0.050 
DO83 12.000 12.000 80.000 0.006 
K2ce 40.000 187.000 187.000 -0.008 
K623 5.000 5.000 28.000 0.048 
K624 10.000 10.000 45.000 0.019 
K225 6.000 6.000 20.000 0.010 
K323 3.000 3.000 50.000 0.010 
K325 4.000 4.000 25.000 0.010 
K524 4.000 4.000 25.000 0.041 
K321 35.000 108.600 204.000 ; 
$271 25.000 25.000 105.000 0.004 
S051 15.000 15.000 20.500 0.023 
Soll 3.000 3.000 13.300 0.057 
$052 15.000 15.000 31.000 0.020 
$053 3.000 3.000 19.200 0.007 
$243 3.000 15.000 15.000 -0.003 
$402 3.000 3.000 35.000 0.017 
$091 5.000 5.000 35.500 0.004 
$102 2.000 2.000 20.000 0.016 
$281 12.000 12.000 159.400 0.018 
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2 OLUVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 
see SOLVER STATUS 1 NORMAL COMPLETION 
sees MODEL STATUS 1 OPTIMAL 
sexe OBJECTIVE VALUE 12.5762 
LOWER LEVEL UPPER MARGINAL 
“--- EQU COST ~INF 1029.100 1029.100 “0.011 
wen-- EQU PAYOFF 68.259 68.259 68.259 0.425 
“--- EQU RISK 7.143 7.143 7.143 -0.425 
---- EQU TIME 1.195 Tela Teloo -0.093 
“--- EQU BALANCE 52.861 52.861 52.861 0.056 
we-- EQU OBJDEF : . . -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 


PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER @ - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
w--- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY8&83 
LOWER LEVEL UPPER MARGINAL 
B1l22 6.000 6.000 37.000 0.024 
B142 2.000 15.000 15.000 -0.007 
B412 9.000 9.000 28.000 0.026 
B532 30.000 95.000 95.000 -0.006 
B612 2.000 2.000 25.000 0.024 
L008 5.000 5.000 30.000 0.012 
L212 2.000 2.000 12.000 0.011 
L503 5.000 5.000 24.000 0.014 
L721 2.000 2.000 12.000 0.012 
L723 2.000 2.000 10.000 0.012 
D044 1.000 15.000 15.000 -0.012 
DO76 50.000 260.000 260.000 -0.011 
DO80 5.000 — 5.000 25.000 0.019 
D047 15.000 15.000 55.000 0.001 
D112 1.000 1.000 8.000 0.041 
D114 6.000 6.000 20.000 0.046 
0083 12.000 12.000 80.000 0.002 
K222 40.000 187.000 187.000 -0.012 
K623 5.000 5.000 28.000 0.044 
K624 10.000 10.000 45.000 0.015 
K225 6.000 6.000 20.000 0.006 
K323 3.000 3.000 50.000 0.006 
K325 4.000 4.000 25.000: 0.006 
K524 4.000 4.000 25.000 0.037 
K321 35.000 204.000 204.000 -0.004 
$271 25.000 76.100 105.000 : 
$051 15.000 15.000 20.500 0.019 
soll 3.000 3.000 13.300 0.053 
$052 15.000 15.000 31.000 0.016 
$053 3.000 3.000 19.200 0.003 
$243 3.000 15.000 15.000 -0.007 
$402 3.000 3.000 35.000 0.013 
$091 5.000 5.000 35.500 9.0002E-5 
$102 2.000 2.000 20.000 0.012 
$281 12.000 12.000 159.400 0.01% 
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SOLVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP OIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 
sere SOLVER STATUS 1 NORMAL COMPLETION 
weet MODEL STATUS 1 OPTIMAL 
sae OBJECTIVE VALUE 10.5273 
LOWER CEVEE UPPER MARGINAL 
ss— = EQUNCOS1 ~INF 1255.400 1255.400 -0.005 
---- EQU PAYOFF 68.259 68.259 68.259 0.425 
---- EQU RISK 7.143 7.143 7.143 -0.425 
“=== EQU TI 7.793 7.793 7.793 -0.093 
~--- EQU BALANCE 52.861 52.861 52.861 0.056 
---- EQU OBJDEF . : ‘ -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER @ = MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM OURING FY8S 
LOWER LEVEL UPPER MARGINAL 
Bl22 6.000 6.000 37.000 0.018 
B14¢2 2.000 15.000 15.000 -0.013 
BG12 9.000 9.000 28.000 0.020 
B532 30.000 95.000 95.000 -0.012 
Bél12 2.000 2.000 25.000 0.018 
L008 5.000 5.000 30.000 0.006 
L212 2.000 2.000 12.000 0.005 
L503 5.000 5.000 24.000 0.008 
L721 2.000 2.000 12.000 0.006 
L723 2.000 2.000 10.000 0.006 
0044 1.000 15.000 15.000 -0.018 
0076 50.000 260.000 260.000 -0.017 
0080 5.000 5.000 25.000 0.013 
0047 15.000 55.000 55.000 -0.005 
Dii2 1.000 1.000 8.000 0.035 
0114 6.000 6.000 20.000 0.040 
0083 12.000 80.000 80.000 -0.00¢ 
K222 40.000 187.000 187.000 -0.018 
K623 5.000 5.000 28.000 0.038 
K624¢ 10.000 10.000 45.000 0.009 
K225 6.000 20.000 20.000 EPS 
K323 3.000 10.700 50.000 : 
K325 4.000 25.000 25.000 -4.250E-4 
K524¢ 4.000 4.000 25.000 0.030 
K321 35.000 204.000 204.000 -0.010 
$271 25.000 105.000 105.000 -0.006 
$o51 15.000 15.000 20.500 0.013 
Soll 3.000 3.000 13.300 0.047 
$052 15.000 15.000 31.000 0.010 
$053 3.000 19.200 19.200 -0.003 
$243 3.000 15.000 15.000 -0.013 
S402 3.000 3.000 35.000 0.007 
$091 5.000 35.500 35.500 -0.006 
$102 2.000 2.000 20.000 0.006 
$281 12.000 12.000 159.400 0.008 
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SOLVE SUMMARY 
MODEL GP OBJECTIVE DOEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BOMLP FROM LINE 450 
ee" SOLVER STATUS 1 NORMAL COMPLETION 
xe% MODEL STATUS 1 OPTIMAL 
se OBJECTIVE VALUE 10.3264 
LOWER LEVEL UPPER MARGINAL 
---- EQU COST - INF 1304¢.700 1383.400 : 
---- EQU PAYOFF 68.259 68.259 68.259 0.425 
“--- EQU RISK 7.1943 7.1943 7.143 -0.425 
---- EQU TIME 7.793 7.793 7.793 -0.093 
---- EQU BALANCE 52.861 52.861 52.861 0.056 
“--- EQU OBJDEF ; : 4 -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 


PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4 - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.013 
B142 2.000 15.000 15.000 -0.018 
B412 9.000 9.000 28.000 0.015 
B532 30.000 95.000 95.000 -0.017 
B612 2.000 2.000 25.000 0.013 
Loos 5.000 5.000 30.000 7.8100E-4 
L212 2.000 12.000 12.000 -6.900E-5 
L503 5.000 5.000 24.000 0.003 
L721 2.000 2.000 12.000 9.4000E-4 
L723 2.000 2.000 10.000 9.4000E-4 
D044 1.000 15.000 15.000 -0.023 
D076 50.000 260.000 260.000 -0.022 
D080 5.000 5.000 25.000 0.008 
D047 15.000 55.000 55.000 -0.010 
D112 1.000 1.000 8.000 0.029 
0114 6.000 6.000 20.000 0.035 
p083 12.000 80.000 80.000 -0.009 
K222 40.000 187.000 187.000 -0.023 
K623 5.000 5.000 28.000 0.033 
K624 10.000 10.000 45.000 0.004 
K225 6.000 20.000 20.000 -0.005 
K323 3.000 50.000 50.000 -0.005 
K325 4.000 25.000 25.000 -0.006 
K524 4.000 4.000 25.000 0.025 
K321 35.000 204.000 204.000 -0.015 
$271 25.000 105.000 105.000 -0.011 
$051 15.000 15.000 20.500 0.008 
soll 3.000 3.000 13.300 0.042 
$052 15.000 15.000 31.000 0.005 
$053 3.000 19.200 19.200 -0.008 
$243 3.000 15.000 15.000 -0.018 
$402 3.000 3.000 35.000 0.002 
$091 5.000 35.500 35.500 -0.011 
$102 2.000 2.000 20.000 5.5800E-4 
$281 12.000 12.000 159.400 0.003 
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SOLVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDOMLP FROM LINE 450 
saeexe SOLVER STATUS 1 NORMAL COMPLETION 
were MODEL STATUS 1 OPTIMAL 
woes OBJECTIVE VALUE 12.6275 
LOWER LEVEL UPPER MARGINAL 
“--- EQU COST INF 882.600 882.600 -0.010 
“--- EQU PAYOFF 68.259 68.259 68.259 0.330 
---- EQU RISK 7.193 7.143 7.143 -0.542 
wne= EQU TING 7.793 7.793 72195 -0.079 
“--- EQU BALANCE 52.861 52.861 52.861 0.048 
---- EQU OBJDEF : : : -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 


PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4 - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.031 
B142 2.000 15.000 15.000 -0.003 
B412 9.000 9.000 28.000 0.032 
B532 30.000 95.000 95.000 -0.002 
B6l2 2.000 2.000 25.000 0.027 
Loos 5.000 5.000 30.000 0.016 
L212 2.000 2.000 12.000 0.016 
L503 5.000 5.000 24.000 0.021 
L721 2.000 2.000 12.000 0.015 
L723 2.000 2.000 -10.000 0.015 
D044 1.000 15.000 15.000 -0.006 
0076 50.000 260.000 260.000 -0.005 
0080 5.000 5.000 25.000 0.022 
0047 15.000 15.000 55.000 0.004 
0112 1.000 1.000 8.000 0.046 
D114 6.000 6.000 20.000 0.053 
D083 12.000 12.000 80.000 0.004 
K222 40.000 187.000 187.000 -0.005 
K623 5.000 5.000 28.000 0.052 
K624 10.000 10.000 45.000 0.019 
K225 6.000 6.000 20.000 0.008 
K323 3.000 3.000 50.000 0.008 
K325 4.000 4.000 25.000 0.008 
K524 4.000 4.000 25.000 0.043 
K321 35.000 108.600 204.000 : 
$271 25.000 25.000 105.000 0.005 
S051 15.000 15.000 20.500 0.025 
soll 3.000 3.000 13.300 0.064 
S052 15.000 15.000 31.000 0.021 
sos3 3.000 3.000 19.200 0.006 
$243 3.000 15.000 15.000 -0.003 
$402 3.000 3.000 35.000 0.016 
$091 5.000 5.000 35.500 0.003 
$102 2.000 2.000 20.000 0.014 
$281 12.000 12.000 159.400 0.017 
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> OL VE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP OIRECTION MINIMIZE 
SOLVER S8OMLP FROM LINE 450 
wee SOLVER STATUS 1 NORMAL COMPLETION 
wee MODEL STATUS 1 OPTIMAL 
sexe OBJECTIVE VALUE 11.3794 
LOWER LEVEL UPPER MARGINAL 
~--- EQU COST - INF 1029.100 1029.100 -0.006 
“--- EQU PAYOFF 68.259 68.259 68.259 0.330 
“--- EQU RISK 7.193 7.143 7.193 -0.542 
---- EQU TIME 7.793 7.195 7.793 -0.079 
“--- EQU BALANCE 52.861 52.861 52.861 0.048 
---- EQU OBJDEF : : : -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER @ - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
~--- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.027 
B142 2.000 15.000 15.000 -0.007 
B412 9.000 9.000 28.000 0.028 
B532 30.000 95.000 95.000 -0.006 
B6l2 2.000 2.000 25.000 0.023 
Loos 5.000 5.000 30.000 0.013 
L212 2.000 2.000 12.000 0.012 
L503 5.000 5.000 24.000 0.017 
L721 2.000 2.000 12.000 0.012 
L723 2.000 2.000 10.000 0.012 
0044 1.000 15.000 15.000 -0.010 
D076 50.000 260.000 260.000 -0.009 
D080 5.000 5.000 25.000 0.018 
0047 15.000 15.000 55.000 3.8600E-% 
0112 1.000 1.000 8.000 0.043 
0114 6.000 6.000 20.000 0.049 
0083 12.000 32.600 80.000 : 
K222 40.000 187.000 187.000 -0.009 
K623 5.000 5.000 28.000 0.049 
K624 10.000 10.000 45.000 0.015 
K225 6.000 6.000 20.000 0.005 
K323 3.000 3.000 50.000 0.005 
K325 4.000 4.000 25.000 0.004 
K524¢ 4.000 4.000 25.000 0.040 
K321 35.000 204.000 204.000 -0.004 
$271 25.000 25.000 105.000 0.002 
So51 15.000 15.000 20.500 0.021 
Soll 3.000 3.000 13.300 0.061 
$052 15.000 15.000 31.000 0.017 
S053 3.000 3.000 19.200 0.002 
$243 3.000 15.000 15.000 -0.007 
S402 3.000 3.000 35.000 0.012 
S091 5.000 35.500 35.500 -9.600E-5 
$102 2.000 2.000 20.000 0.011 
S281 12.000 12.000 159.400 0.013 
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3 O° £ SUMMARY 


MOOEL GP OBJECTIVE OEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BOMLP FROM LINE 450 


SOLVER STATUS 1 NORMAL COMPLETION 


weet MOOEL STATUS 1 OPTIMAL 
wee OBJECTIVE VALUE 10.3%46 
LOWER LEVEL UPPER MARGINAL 
~~-- EQU COST - INF 1255.4¢00 1255.%¢00 -0.002 
---- EQU PAYOFF 68.259 68.259 68.259 0.330 
w--- EQU RISK 7.143 7.143 7.143 -0.542 
een= EQUUS TIME 7.793 Toto T.995 -0.079 
---- EQU BALANCE 52.861 52.861 52.861 0.048 
---- EQU OBJOEF . : ° -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUOGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4 - MAXIMIZE BALANCE 
OBJOEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM OURING FY8&8& 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.022 
B142 2.000 15.000 15.000 -0.011 
B412 9.000 9.000 28.000 0.023 
B532 30.000 95.000 95.000 -0.010 
Bél12 2.000 2.000 25.000 0.018 
Loos 5.000 5.000 30.000 0.008 
E2ziz 2.000 2.000 12.000 0.007 
L503 5.000 5.000 24.000 0.012 
L721 2.000 2.000 12.000 0.007 
ives 2.000 2.000 10.000 0.007 
0044 1.000 15.000 15.000 -0.01% 
0076 50.000 260.000 260.000 -0.014 
0080 5.000 5.000 25.000 0.014 
0047 15.000 55.000 55.000 -0.004¢ 
0112 1.000 1.000 8.000 0.038 
011% 6.000 6.000 20.000 0.045 
0083 12.000 80.000 80.000 -0.005 
K222 40.000 187.000 187.000 -0.014 
K623 5.000 5.000 28.000 0.044 
K624 10.000 10.000 45.000 0.011 
K225 6.000 20.000 20.000 EPS 
K323 3.000 10.700 50.000 ; 
K325 4.000 25.000 25.000 -5.4%20E-4 
K524¢ 4.000 4.000 25.000 0.035 
K321 35.000 204.000 204.000 -0.008 
$271 25.000 105.000 105.000 -0.003 
$051 15.000 15.000 20.500 0.016 
Soll 3.000 3.000 13.300 0.056 
$052 15.000 15.000 31.000 0.012 
S053 3.000 19.200 19.200 -0.002 
$243 3.000 15.000 15.000 -0.011 
$402 3.000 3.000 35.000 0.008 
$091 5.000 35.500 35.500 -0.005 
$102 2.000 2.000 20.000 0.006 
$281 12.000 12.000 159.400 0.009 
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SO UV E Ss UMM AR Y 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BOMLP FROM LINE 4%50 
weet SOLVER STATUS 1 NORMAL COMPLETION 
wees MODEL STATUS 1 OPTIMAL 
weet OBJECTIVE VALUE 10.2854 
LOWER LEVEL UPPER MARGINAL 
~--- EQU COST ~INF 1294.700 1383.%00 : 
~--- EQU PAYOFF 68.259 68.259 68.259 0.330 
w--- EQU RISK 7.143 7.143 7.143 -0.542 
---- EQU TIME 7.793 7.793 7.793 -0.079 
w--- EQU BALANCE 52.861 52.861 52.861 0.048 
---- EQU OBJDEF : : : -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4% - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
~--- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY8&8& 
LOWER LEVEL UPPER MARGINAL 
Bl22 6.000 6.000 37.000 0.021 
B142 2.000 15.000 15.000 -0.013 
B12 9.000 9.000 28.000 0.022 
B532 30.000 95.000 95.000 -0.012 
B612 2.000 2.000 25.000 0.017 
L008 5.000 5.000 30.000 0.007 
L212 2.000 2.000 12.000 0.006 
L503 5.000 5.000 24.000 0.011 
L721 2.000 2.000 12.000 0.006 
L723 2.000 2.000 10.000 0.006 
D044 1.000 15.000 15.000 -0.016 
DO76 50.000 260.000 260.000 -0.015 
DO8O 5.000 5.000 25.000 0.012 
D047 15.000 55.000 55.000 -0.006 
D1l2 1.000 1.000 8.000 0.037 
D114 6.000 6.000 20.000 0.043 
D083 12.000 80.000 80.000 -0.006 
K222 40.000 187.000 187.000 -0.015 
K623 5.000 5.000 28.000 0.043 
K62% 10.000 10.000 45.000 0.009 
K225 6.000 20.000 20.000 -0.002 
K323 3.000 50.000 50.000 -0.002 
K325 4.000 25.000 25.000 -0.002 
K524 4.000 4.000 25.000 0.034 
K321 35.000 204.000 204.000 -0.010 
$271 25.000 105.000 105.000 ~0.005 
$051 15.000 15.000 20.500 0.015 
Soll 3.000 3.000 13.300 0.055 
$052 15.000 15.000 31.000 0.011 
S053 3.000 19.200 19.200 -0.004¢ 
$243 3.000 15.000 15.000 -0.013 
$402 3.000 3.000 35.000 0.006 
$O91 5.000 35.500 35.500 -0.006 
$102 2.000 2.000 20.000 0.00% 
$281 12.000 12.000 159.400 0.007 
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> O° Vv=E SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 
saeee SOLVER STATUS 1 NORMAL COMPLETION 
weer MODEL STATUS 1 OPTIMAL 
sae OBJECTIVE VALUE 12.1938 
LOWER LEVEL UPPER MARGINAL 
“--- EQU COST - INF 882.600 882.600 -0.003 
“--- EQU PAYOFF 68.259 68.259 68.259 0.250 
“--- EQU RISK 7.143 7.143 7.143 -0.152 
---- EQU TIME 7.793 7219) 7.793 -0.557 
---- EQU BALANCE 52.861 52.861 52.861 0.041 
---- EQU OBJDEF : : -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER @ - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88& 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.031 
B14¢2 2.000 15.000 15.000 -0.005 
B412 9.000 9.000 28.000 0.032 
B532 30.000 95.000 95.000 -0.005 
B612 2.000 2.000 25.000 0.02% 
LOO0s8 5.000 5.000 30.000 0.018 
L212 2.000. 2.000 12.000 0.018 
L503 5.000 5.000 24.000 0.015 
L721 2.000 2.000 12.000 . 0.013 
L723 2.000 2.000 10.000 0.013 
D044 1.000 15.000 15.000 -0.008 
DO76 50.000 260.000 260.000 -0.003 
DO80 5.000 5.000 25.000 0.022 
DOG7 15.000 20.600 55.000 : 
D112 1.000 1.000 8.000 0.047 
D114% 6.000 6.000 20.000 0.049 
DO8s3 12.000 80.000 80.000 -9.880E-4 
K222 40.000 187.000 187.000 -0.001 
K623 5.000 5.000 28.000 0.025 
K624 10.000 10.000 45.000 0.028 
K225 6.000 6.000 20.000 0.014 
K323 3.000 3.000 50.000 0.014 
K325 4.000 4.000 25.000 0.01% 
K524 4.000 4.000 25.000 0.02% 
K321 35.000 35.000 204.000 0.002 
S271 25.000 25.000 105.000 0.00% 
S051 15.000 15.000 20.500 0.017 
Soll 3.000 3.000 13.300 0.058 
$052 15.000 15.000 31.000 0.016 
$053 3.000 3.000 19.200 0.002 
S243 3.000 15.000 15.000 -0.005 
3402 3.000 3.000 35.000 0.019 
S091 5.000 5.000 35.500 0.003 
$102 2.000 2.000 20.000 0.018 
S281 12.000 12.000 159.400 0.018 
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SOLVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 
see" SOLVER STATUS 1 NORMAL COMPLETION 
see MODEL STATUS 1 OPTIMAL 
xeaeex OBJECTIVE VALUE 11.9538 
LOWER LEVEL UPPER MARGINAL 
---- EQU COST -INF 1029.100 1029.100 -0.001 
---- EQU PAYOFF 68.259 68.259 68.259 0.250 
---- EQU RISK 7.143 7.143 7.143 -0.152 
---- EQU TIME (2293 12195 7.793 -0.557 
“--- EQU BALANCE 52.861 52.861 52.861 0.041 
---- EQU OBJDEF ‘ : ; -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4 - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88& 
LOWER LEVEL UPPER MARGINAL 
Bl22 6.000 6.000 37.000 0.029 
B142 2.000 15.000 15.000 -0.007 
B412 9.000 9.000 28.000 0.030 
B532 30.000 95.000 95.000 -0.007 
B612 2.000 2.000° 25.000 0.022 
L008 5.000 5.000 30.000 0.016 
L212 2.000 2.000 12.000 0.016 
L503 5.000 5.000 24.000 0.013 
L721 2.000 2.000 12.000 0.011 
L723 2.000 2.000 10.000 0.011 
D044 1.000 15.000 15.000 -0.010 
D076 50.000 260.000 260.000 -0.005 
DO8O 5.000 5.000 25.000 0.020 
D047 15.000 55.000 55.000 -0.002 
D112 1.000 1.000 8.000 0.045 
0114 6.000 6.000 20.000 0.047 
0083 12.000 80.000 80.000 -0.003 
K222 40.000 187.000 187.000 -0.003 
K623 5.000 5.000 28.000 0.023 
K624 10.000 10.000 45.000 0.026 
K225 6.000 6.000 20.000 0.013 
K323 3.000 3.000 50.000 0.013 
K325 4.000 4.000 25.000 0.012 
K524¢ 4.000 4.000 25.000 0.022 
K321 35.000 147.100 204.000 : 
S271 25.000 25.000 105.000 0.002 
so51 15.000 15.000 20.500 0.015 
$011 3.000 3.000 13.300 0.056 
S052 15.000 15.000 31.000 0.014 
3053 3.000 3.000 19.200 4.8300E-4% 
3243 3.000 15.000 15.000 -0.007 
$402 3.000 3.000 35.000 0.017 
S091 5.000 5.000 35.500 0.001 
$102 2.000 2.000 20.000 0.016 
S281 12.000 12.000 159.400 0.016 


Ss Ort Vae SUMMARY 


MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 
sexe SOLVER STATUS 1 NORMAL COMPLETION 
wee MODEL STATUS 1 OPTIMAL 
see OBJECTIVE VALUE 11.8754 
LOWER LEVEL UPPER MARGINAL 
---- EQU COST ~INF 1102.200 1255.%00 : 
~--- EQU PAYOFF 68.259 68.259 68.259 0.250 
~--- EQU RISK 7.143 7.143 7.143 -0.152 
<e== EQUSTIME 7.793 (3195 le195 =0.557 
---- EQU BALANCE 52.861 52.861 52.861 0.041 
---- EQU OBJDEF : ° : -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER @ - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
~--- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY838 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.028 
B142 2.000 15.000 15.000 -0.009 
B412 9.000 9.000 28.000 0.028 
B532 30.000 95.000 95.000 -0.008 
B612 2.000 2.000 25.000 0.021 
LOO8 5.000 5.000 30.000 0.015 
L212 2.000 2.000 12.000 0.015 
L503 5.000 5.000 24.000 0.011 
L721 2.000 2.000 12.000 0.010 
L723 2.000 2.000 10.000 0.010 
D044 1.000 15.000 15.000 -0.011 
D076 50.000 260.000 260.000 -0.006 
D080 5.000 5.000 25.000 0.019 
D047 15.000 55.000 55.000 -0.003 
D112 1.000 1.000 8.000 0.043 
D114 6.000 6.000 20.000 0.045 
D083 12.000 80.000 80.000 -0.004¢ 
K222 40.000 187.000 187.000 -0.005 
K623 5.000 5.000 28.000 0.021 
K629 10.000 10.000 45.000 0.024 
K225 6.000 6.000 20.000 0.011 
K323 3.000 3.000 50.000 0.011 
K325 4.000 4.000 25.000 0.011 
K524 4.000 4.000 25.000 0.021 
K321 35.000 204.000 204.000 -0.001 
$27] 25.000 25.000 105.000 8.6800E-4 
SOS] 15.000 15.000 20.500 0.014 
Soll 3.000 3.000 13.300 0.055 
$052 15.000 15.000 31.000 0.013 
$053 3.000 19.200 19.200 -6.970E-% 
$293 3.000 15.000 15.000 -0.008 
$402 3.000 3.000 35.000 0.016 
SO91 5.000 5.000 35.500 1.9000E-4 
$102 2.000 2.000 20.000 0.014 
$281 12.000 12.000 159.400 0.015 
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SOLVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 
xe SOLVER STATUS 1 NORMAL COMPLETION 
saeee MODEL STATUS 1 OPTIMAL 
xe OBJECTIVE VALUE 11.8754 
LOWER LEVEL UPPER MARGINAL 
---- EQU COST “INF 1102.200 1383.400 ; 
~--- EQU PAYOFF 68.259 68.259 68.259 0.250 
---- EQU RISK 7.143 7.143 7.143 -0.152 
---- EQU TIME 7.793 7.793 7.793 -0.557 
---- EQU BALANCE 52.861 52.861 52.861 0.041 
---- EQU OBJDEF ‘ : ‘ -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4 - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.028 
B142 2.000 15.000 15.000 -0.009 
B12 9.000 9.000 28.000 0.028 
B532 30.000 95.000 95.000 -0.008 
B612 2.000 2.000 25.000 0.021 
Loos 5.000 5.000 30.000 0.015 
L212 2.000 2.000 12.000 0.015 
L503 5.000 5.000 24.000 0.011 
L721 2.000 2.000 12.000 0.010 
L723 2.000 2.000 10.000 0.010 
D044 1.000 15.000 15.000 -0.011 
0076 50.000 260.000 260.000 -0.006 
D080 5.000 5.000 25.000 0.019 
D047 15.000 55.000 55.000 -0.003 
0112 1.000 1.000 8.000 0.043 
D114 6.000 6.000 20.000 0.045 
0083 12.000 80.000 80.000 -0.004 
K222 40.000 187.000 # 187.000 -0.005 
K623 5.000 5.000 28.000 0.021 
K624 10.000 10.000 45.000 0.024 
K225 6.000 6.000 20.000 0.011 
K323 3.000 3.000 50.000 0.011 
K325 4.000 4.000 25.000 0.011 
K524 4.000 4.000 25.000 0.021 
K321 35.000 204.000 204.000 -0.001 
$271 25.000 25.000 105.000 8.6800E-4 
$051 15.000 15.000 20.500 0.014 
Soll 3.000 3.000 13.300 0.055 
$052 15.000 15.000 31.000 0.013 
$053 3.000 19.200 19.200 -6.970E-4 
$243 3.000 15.000 15.000 -0.008 
$402 3.000 3.000 35.000 0.016 
so09l 5.000 5.000 35.500 1.9000E-4 
$102 2.000 2.000 20.000 0.014 
$281 12.000 12.000 159.400 0.015 
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SOLVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BODOMLP FROM LINE 450 
see SOLVER STATUS 1 NORMAL COMPLETION 
sane MODEL STATUS 1 OPTIMAL 
wieee OBJECTIVE VALUE 15.7470 
LOWER LEVEL UPPER MARGINAL 
---- EQU COST -INF 882.600 882.600 -0.013 
---- EQU PAYOFF 68.259 68.259 68.259 0.250 
w--- EQU RISK 7.143 7.193 7.143 -0.250 
<-=- EQUI TIME 7.793 7.793 7.793 -0.250 
---- EQU BALANCE 52.861 52.861 52.861 0.250 
---- EQU OBJDEF , , ° -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 


PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4 - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.025 
B142 2.000 15.000 15.000 -0.002 
B412 9.000 9.000 28.000 0.026 
B532 30.000 95.000 95.000 -0.003 
B612 2.000 2.000 25.000 0.020 
Loos 5.000 5.000 30.000 0.014 
Re 2.000 2.000 12.000 0.014 
L503 5.000 5.000 24.000 0.014 
L721 2.000 2.000 12.000 0.012 
L723 2.000 2.000 10.000 0.012 
D044 1.000 15.000 15.000 -0.005 
D076 50.000 260.000 260.000 -0.002 
DOs0 5.000 5.000 25.000 0.019 
D047 15.000 15.000 55.000 0.003 
0112 1.000 1.000 8.000 0.037 
D114 6.000 6.000 20.000 0.040 
D083 12.000 12.000 80.000 0.003 
K222 40.000 187.000 #£187.000 -0.004 
K623 5.000 5.000 28.000 0.029 
K624 10.000 10.000 45.000 0.021 
K225 6.000 6.000 20.000 0.012 
K323 3.000 3.000 50.000 0.012 
K325 4.000 4.000 25.000 0.011 
K524 4.000 4.000 25.000 0.025 
K321 35.000 108.600 204.000 3 
S271 25.000 25.000 105.000 0.003 
$051 15.000 15.000 20.500 0.017 
$011 3.000 3.000 13.300 0.047 
$052 15.000 15.000 31.000 0.015 
$053 3.000 3.000 19.200 0.004 
$243 3.000 15.000 15.000 -0.001 
$402 3.000 3.000 35.000 0.016 
$091 5.000 5.000 35.500 0.002 
$102 2.000 2.000 20.000 0.014 
$281 12.000 12.000 159.400 0.016 
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>» OLVE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 
see SOLVER STATUS 1 NORMAL COMPLETION 
sexe MODEL STATUS 1 OPTIMAL 
see OBJECTIVE VALUE 13.9388 
LOWER LEVEL UPPER MARGINAL 
“--- EQU COST ~INF 1029.100 1029.100 -0.010 
~--- EQU PAYOFF 68.259 68.259 68.259 0.250 
---- EQU RISK 7.143 7.1493 7.143 -0.250 
--<-- EQU TIME 7.793 7.793 7.793 -0.250 
---- EQU BALANCE 52.861 52.861 52.861 0.250 
---- EQU OBJDEF . : : -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 


PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER 4 - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.022 
B142 2.000 15.000 15.000 -0.004 
BG12 9.000 9.000 28.000 0.023 
B532 30.000 95.000 95.000 -0.005 
B612 2.000 2.000 25.000 0.017 
Loos 5.000 5.000 30.000 0.011 
L212 2.000 2.000 12.000 0.011 
L503 5.000 5.000 24.000 0.011 
L721 2.000 2.000 12.000 0.009 
L723 2.000 2.000 10.000 0.009 
D044 1.000 15.000 15.000 -0.008 
D076 50.000 260.000 # 260.000 -0.005 
p08s0 5.000 5.000 25.000 0.016 
0047 15.000 15.000 55.000 2.5000E-4 
D112 1.000 1.000 8.000 0.034 
D114 6.000 6.000 20.000 0.037 
D083 12.000 32.600 80.000 ; 
K222 40.000 187.000 # 187.000 ~0.007 
K623 5.000 5.000 28.000 © 0.026 
K624 10.000 10.000 45.000 0.018 
K225 6.000 6.000 20.000 0.009 
K323 3.000 3.000 50.000 0.009 
K325 4.000 4.000 25.000 0.009 
K524 4.000 4.000 25.000 0.022 
K321 35.000 204.000 204.000 -0.003 
$271 25.000 25.000 105.000 5.0000E-4 
$051 15.000 15.000 20.500 0.014 
soll 3.000 3.000 13.300 0.044 
$052 15.000 15.000 31.000 0.012 
$053 3.000 3.000 19.200 0.002 
$243 3.000 15.000 15.000 -0.004 
$402 3.000 3.000 35.000 0.013 
$091 5.000 35.500 35.500 -2.500E-4 
$102 2.000 2.000 20.000 0.011 
$281 12.000 12.000 159.400 0.013 
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SOLVE SUMMARY 


MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 


sae SOLVER STATUS 1 NORMAL COMPLETION 
sxe MODEL STATUS 1 OPTIMAL 
woeee OBJECTIVE VALUE 12.0200 

LOWER LEVEL UPPER MARGINAL 
---- EQU COST “INF 1255.400 1255.400 -0.001 
---- EQU PAYOFF 68.259 68.259 68.259 0.250 
---- EQU RISK 7.143 7.143 7.143  -0.250 
---- EQU TIME 7.793 7.793 7.793 -0.250 
---- EQU BALANCE 52.861 52.861 52.861 0.250 
---- EQU OBJDEF -1.000 

COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 


PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER @ - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
---- VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.013 
B142 2.000 15.000 15.000 -0.013 
B12 9.000 9.000 28.000 0.01% 
B532 30.000 95.000 95.000 -0.01% 
Bé612 2.000 2.000 25.000 0.008 
Loos 5.000 5.000 30.000 0.002 
L212 2.000 2.000 12.000 0.002 
L503 5.000 5.000 24.000 0.002 
L721 2.000 2.000 12.000 2.5000E-4¢ 
L723 2.000 2.000 10.000 2.5000E-4 
D044 1.000 15.000 15.000 -0.017 
DO76 50.000 260.000 260.000 -0.014 
DO80 5.000 5.000 25.000 0.007 
D047 15.000 55.000 55.000 -0.009 
D1i2 1.000 1.000 8.000 0.025 
011% o.000 © .000 20.000 0.028 
D083 12.000 80.000 80.000 -0.009 
K222 40.000 187.000 187.000 -0.016 
K623 5.000 5.000 28.000 0.017 
K62¢ 10.000 10.000 45.000 0.009 
K225 6.000 20.000 20.000 EPS 
K323 3.000 10.700 50.000 : 
K325 4.000 25.000 25.000 -2.500E-4 
K52¢ 4.000 4.000 25.000 0.013 
K321 35.000 204.000 204.000 -0.012 
$271 25.000 105.000 105.000 -0.008 
S051 15.000 15.000 20.500 0.005 
soll 3.000 3.000 13.300 0.035 
S052 15.000 15.000 31.000 0.003 
$053 3.000 19.200 19.200 -0.007 
$243 3.000 15.000 15.000 -0.013 
$402 3.000 3.000 35.000 0.004 
$091 5.000 35.500 35.500 -0.009 
$102 2.000 2.000 20.000 0.002 
S281 12.000 12.000 159.400 0.004 


te 


sO Lt VE SUMMARY 
MODEL GP OBJECTIVE DEVIATION 
TYPE LP DIRECTION MINIMIZE 
SOLVER BDMLP FROM LINE 450 
set SOLVER STATUS 1 NORMAL COMPLETION 
sane MODEL STATUS 1 OPTIMAL 
seeee OBJECTIVE VALUE 11.9386 
LOWER LEVEL UPPER MARGINAL 
~--- EQU COST ~INF 1312.700 1383.400 ° 
~--- EQU PAYOFF 68.259 68.259 68.259 0.250 
w--- EQU RISK 7.143 7.143 7.143 -0.250 
=== EQ) Vine 71.195 7.793 7.793 -0.250 
~--- EQU BALANCE 52.861 52.861 52.861 0.250 
~--- EQU OBJDEF : ° : -1.000 
COST COST OF PROGRAMS CANNOT EXCEED THE BUDGET 
PAYOFF GOAL NUMBER 1 - MAXIMIZE PAYOFF 
RISK GOAL NUMBER 2 - MINIMIZE RISK 
TIME GOAL NUMBER 3 - MINIMIZE TIME 
BALANCE GOAL NUMBER @ - MAXIMIZE BALANCE 
OBJDEF ACHIEVEMENT FUNCTION 
ame= VAR X MONEY TO BE SPENT IN EACH PROGRAM DURING FY88& 
LOWER LEVEL UPPER MARGINAL 
B122 6.000 6.000 37.000 0.012 
B142 2.000 15.000 15.000 -0.015 
B412 9.000 9.000 28.000 0.012 
B532 30.000 95.000 95.000 -0.016 
6612 2.000 2.000 25.000 0.007 
L008 5.000 5.000 30.000 0.001 
L212 2.000 2.000 12.000 5.Q000E-4 
L503 5.000 5.000 24.000 7.5000E-4 
L721 2.000 12.000 12.000 -0.001 
L723 2.000 10.000 10.0900 ~0.001 
D044 1.000 15.000 15.000 -0.018 
DO76 50.000 260.000 260.000 -0.016 
DO80 5.000 5.000 25.000 0.005 
D047 15.000 55.000 55.000 -0.010 
0112 1.9000 1.000 8.000 0.023 
D114 6.000 6.000 20.000 0.026 
D083 12.000 80.000 80.000 -0.010 
K222 40.000 187.000 187.000 -0.017 
K623 5.000 5.000 28.000 0.015 
K624 10.000 10.000 45.000 0.007 
K225 6.000 20.000 20.000 -0.001 
K323 3.000 50.000 50.000 -0.001 
K325 4.000 25.000 25.000 -0.002 
K524 4.000 4.000 25.000 0.012 
K321 35.000 204.000 204.000 -0.013 
$271 25.000 105.000 105.000 -0.010 
S051 15.000 15.000 20.500 0.003 
Soll 3.000 3.000 13.300 0.034 
S052 15.000 15.000 31.000 0.001 
S053 3.000 19.200 19.200 -0.009 
3243 3.000 15.000 15.000 -0.01¢ 
S402 3.000 3.000 35.000 0.002 
Sog91 5.000 35.500 35.500 -0.011 
$102 2.000 2.000 20.000 5.Q000E-4 
$281 12.000 12.000 159.400 0.003 
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